what

Information about what

Published on January 20, 2008

Author: Ulisse

Source: authorstream.com

Content

Whatever Happened to the Promise of Simulation Based Acquisition?:  Whatever Happened to the Promise of Simulation Based Acquisition? NDIA Systems Engineering Conference San Diego, CA October 2003 W. Henson Graves Lockheed Martin Aeronautics Company [email protected], 817.777.1856 Jim Hollenbach Simulation Strategies, Inc. [email protected], 703.360.3902 Simulation Based Acquisition Statement of the Acquisition Council of the DoD Executive Council on Modeling and Simulation, Dec 1997:  Simulation Based Acquisition Statement of the Acquisition Council of the DoD Executive Council on Modeling and Simulation, Dec 1997 SBA Vision: “An acquisition process in which DoD and Industry are enabled by robust, collaborative use of simulation technology that is integrated across acquisition phases and programs” SBA Goals: Substantially reduce the time, resources, and risk associated with the entire acquisition process Increase the quality, military worth and supportability of fielded systems while reducing Total Ownership Costs throughout the total life cycle Enable Integrated Product and Process Development (IPPD) across the entire acquisition life cycle SBA Concepts Have Been Around For 15 Years:  SBA Concepts Have Been Around For 15 Years Arguments for comprehensive application of M&S (88-97) Defense Science Boards; NRC, Service and industry studies Commercial product development automation (CAx, PDM, etc.) Aggressive cost and time goals by VP Gore’s National Performance Review, OSD, and Defense Systems Affordability Council (95-97) SBA Vision statement by DoD Acquisition Council (97) Adoption by several large acquisition programs (97-01) Joint Strike Fighter, DD-21/DD(X), Crusader, FCS DoD’s “Road Map for SBA” (98-99) 400 pages, with architectures and 24 implementation actions Conference papers and press articles (98- ) International interest/initiatives (99- ) Prominent mention in DoD 5000 series directives (01) However, the SBA “Buzz” Has Faded :  However, the SBA “Buzz” Has Faded SBA Road Map never approved Disputes about architectures, traceability, funding, … Revolutionary tone offended/threatened; SBA was never adopted by most acquisition managers and systems engineers No funding at the DOD/Service headquarters level Turbulence in OSD leadership of SBA Dr. Pat Sanders, Director, DTSE&E Mr. John Wilson, Director, Systems Acquisition Dr. V. Garber, Director of Interoperability EXCIMS Acquisition Council and its working group Many new leaders lack M&S expertise, missed SBA arguments 2003 DoD 5000 directives have fewer references to M&S and SBA Reality of the challenges SBA Efforts Are Often Plagued By:  SBA Efforts Are Often Plagued By Impatience with timeliness Lack of appreciation for up-front work required Resistance to process changes Cultural issues abound Suspicion of results Insufficient pedigree/traceability Misunderstanding of M&S capabilities and limitations Push-back from operational testers Limits on how M&S can be used Suspicions about M&S validity … and M&S efforts become a target for funding cuts as other program costs increase and schedules slip Higher costs/unclear ROI Modeling/models & simulations Data acquisition Data preparation Validation and accreditation Analysis of results, reporting No measurable improvement in cost, schedule, risk, or performance No baseline for comparison More complex programs may mean can only avoid increases in each Yet the Advertised Benefits are Still Desired:  Better informed, less risky program management Significant cost savings through modeling and simulation On-time, in-budget, products that meet expectations JSF: Multi-Role, Multi-Service, Multi-National Yet the Advertised Benefits are Still Desired …and the Rationale is Still Sound:  …and the Rationale is Still Sound DoD and commercial M&S use continues to expand Many organizations and programs are pursuing SBA, albeit not necessarily by that name This is empirical evidence about the value of M&S New JCIDS (CJCS 3170) and DOD 5000 directives require a mission capability perspective, increasing need for a comprehensive application of M&S Business as usual, live test, and heroic efforts don’t scale to meet development complexity and are unaffordable Incremental steps forward are yielding real benefits and helping us get smarter about what’s needed to realize SBA SBA Requires More Than M&S Tools :  SBA Requires More Than M&S Tools Revised systems engineering processes to foster life-cycle wide trade space, SoS perspective, earlier CM Contracting to allow tool & info sharing among gov’t & industry, with clear responsibilities and liabilities Availability of improved models and simulations Standards to foster interoperability and reuse Competent professionals and education means Viable business model Ready access to coherent, traceable, authoritative information Data is Usually the Biggest Obstacle:  Data is Usually the Biggest Obstacle Yes, serious cultural issues exist, but most of them involve data sharing! SBA Vision Recognizes That Shared Data is Key to Integrated Product Development:  SBA Vision Recognizes That Shared Data is Key to Integrated Product Development JSF Weapon System Analysis & Integration Team A digital representation of the product …. … stored in a distributed repository to assist in defining, evaluating and managing a weapon system’s entire lifecycle Biggest Data Sharing Impediments:  Biggest Data Sharing Impediments Ignorance of reality No one knows the data flows across an enterprise No one tracks the recurring costs of finding and translating data Few understand the true risks of incorrect or misunderstood data Fear of exposure My failures/shortfalls will be discovered My value to the organization will be diminished Someone will use, or misuse, my data to attack me Misunderstood data meaning Different disciplines/models see the world differently Different abstractions = different objects, processes, attributes, actions, interactions, contexts, semantics, syntax, etc. Mapping among these is problematic Manually checking for coherency is impractical 1. Facing Reality: Information Loss, Corruption and Misunderstanding Cause Rework, Cost and Schedule Overruns:  1. Facing Reality: Information Loss, Corruption and Misunderstanding Cause Rework, Cost and Schedule Overruns BMW, VP for IT "Many processes use the same data. At least 10% of the engineer's pay is lost searching for the right data. We need product info at a mouse click". NIST study: “Imperfect interoperability imposes at least $1B per year on the members of the U.S. automotive supply chain. By far, the greatest component of these costs is the resources devoted to repairing or reentering data files that are not reusable.” Gartner Group study: “40% of corporate IT budgets are spent on application integration.” And lots of defense program horror stories, but “off-the-record” for fear of embarrassment or accountability! Slide13:  Blue systems Threat systems Natural environment Civil/military infrastructure Operational Context (scenarios, etc.) Government provided context information Product Information Model (DPD) (Variants = layered instance values) Functional allocation trade studies Manufacturing/ supplier capabilities Mobility Specialized views: OML, Cost, BOM, mass properties, etc. Transportation capabilities Assemblies & components Software Spatial & electrical relationships Connections Part records System/ subsystem topology Functional allocation Technologies Interfaces Air vehicle performance Mission system capabilities Autonomic logistics Signatures Reliability Scope of the Product Development Information Challenge Lethality/ effectiveness Survivability Manufacturing process Physical architecture (from IPT designers) Support infrastructure Maintainability Performance (from IPT analysts, with gov’t review) Personnel rqmts Interactions (from Kr/gov’t analysts) Logical architecture (from SE/IPT designers) (Requirements are recorded in appropriate information domain) 2. Countering the Fear of Exposure: Learning to Play Well with Others:  2. Countering the Fear of Exposure: Learning to Play Well with Others Must define and enforce responsibilities and liabilities for data sharing Policy guidance, contract boilerplate language Establish a policy of progressive exposure that accounts for normal development/vetting process Respect an individual and organizations sensitivities until a true need-to-know exists Discipline at higher levels not to over-react to preliminary info Provide realistic financial compensation for data sharing A realistic business model among organizations No expectation for uncompensated divestiture of 40 years of experience Use an acquisition/contracting strategy that supports data sharing between government and industry An aversion to GFI means increased cost and risk 3. Fostering Understanding: Engineering the IT Infrastructure :  3. Fostering Understanding: Engineering the IT Infrastructure Take a systems engineering approach Sharing info across an enterprise is itself a complex system An architecture based approach is required, with operational, system and technical views This allows logical integration of diverse database systems Understanding the information flows, and where abstractions change, identifies the “hot spots” Data engineering is required for correct transformations Capturing pedigree metadata about derivation and context assumptions provides a means to foster understanding and check for coherency Web accessibility provides data visibility and an efficient distribution means Complex Data Exchange Needs Exist Across Organizations and Tools, Both Within and Across Phases:  Complex Data Exchange Needs Exist Across Organizations and Tools, Both Within and Across Phases Implementation Time Inter-phase Problems IERs not understood Data not translated between lanes Replicated with misunderstanding Intra-phase Problems Unclear data population schedule Data not accessible Data inconsistent Requirements Analysis Synthesis Architecture Development System Test Unit Test Integration Test JSF Authoritative Modeling Information System (JAMIS) Architecture - Operational View:  JSF Authoritative Modeling Information System (JAMIS) Architecture - Operational View Version 16, 31 Jan 03 Relevant info / DSMs in tool-specific form Analyst action Threat & friendly systems [ASDB] Operational context Natural environment, infrastructure JSF [DPD] Linking & translation services (mapping, semantics/syntax) Resource Access System (RAS) NIMA, DTRA, NRO, etc. Program Offices Intel Centers Services, JFCOM, etc. Threat C&P information Operational context info Natural environment & infrastructure C&P info Blue system C&P info Register authoritative data (JSFPO) Color key: JSFPO provided LM Aero provided Digital System Models Register proposed designs (LM Aero) DISTRIBUTION STATEMENT A: Approved for Public Release; Distribution is Unlimited. Info Model is Key to JAMIS Navigation:  Info Model is Key to JAMIS Navigation Information model as means to locate, navigate, and access distributed data Resource Access System Metaphase MASCOT PVCS Other databases Information Model (info taxonomy and decomposition, interrelationships) & data locations ASDB DOORS RAS application server Web Browser (RAS GUI) Database servers SBA success requires decision makers to understand the cost trades between …:  SBA success requires decision makers to understand the cost trades between … duplication of effort and rework Many independently constructed models of same component Data that is incomplete, inconsistent Day to day costs of information acquisition activities Integration postponed to end, with resulting crises/rework … and investment in Data engineering to understand activities, information flows, IERs and data item relationships Collaborative IT infrastructure to Configuration manage all product development data Capture and track pedigree information about data Make data readily accessible for those that need it Manage change Reusable, evolvable models and data sets that can cross swim lanes Each model costs more, but fewer of them More attention to integrated frameworks and standards so models and data can be reused Summary:  Summary Imperative for accelerated capability development & delivery Pressure for acquisition transform SBA concept accepted Partial successes Technology to enable goals is maturing Contracts that reflect business needs Data/process management policies that support product development needs System engineering approach to data management Redesigned processes to achieve business goals “Rome was not built in one day” Progress is happening incrementally Some key needs to facilitate full realization of SBA’s promises

Related presentations


Other presentations created by Ulisse

wtoprimitivo
08. 05. 2008
0 views

wtoprimitivo

M Naoi IPES2007
07. 05. 2008
0 views

M Naoi IPES2007

atos maxwell jamescfh
02. 05. 2008
0 views

atos maxwell jamescfh

06ESADE
30. 04. 2008
0 views

06ESADE

1 4 Eiropas Kopienas programmas
22. 04. 2008
0 views

1 4 Eiropas Kopienas programmas

5 11
21. 04. 2008
0 views

5 11

phan
18. 04. 2008
0 views

phan

Brown Velocity
17. 04. 2008
0 views

Brown Velocity

SME in Pakistan
10. 01. 2008
0 views

SME in Pakistan

visual perception 1
14. 01. 2008
0 views

visual perception 1

Ross Thompson Presentation
15. 01. 2008
0 views

Ross Thompson Presentation

ArmorofGod ShieldofFaithNew
17. 01. 2008
0 views

ArmorofGod ShieldofFaithNew

Hospital Employee Immunization 1
17. 01. 2008
0 views

Hospital Employee Immunization 1

EnhancingCoreWeb
10. 01. 2008
0 views

EnhancingCoreWeb

A C 8 US CHAPTER
10. 01. 2008
0 views

A C 8 US CHAPTER

6 SMS
18. 01. 2008
0 views

6 SMS

textiles grad 2006
22. 01. 2008
0 views

textiles grad 2006

SessIIBYeboahEtAl
22. 01. 2008
0 views

SessIIBYeboahEtAl

hfcourse frzn
19. 01. 2008
0 views

hfcourse frzn

Heezen overview of cases
22. 01. 2008
0 views

Heezen overview of cases

2c
23. 01. 2008
0 views

2c

language
14. 01. 2008
0 views

language

10 Cash Control
04. 02. 2008
0 views

10 Cash Control

gsoverview
04. 02. 2008
0 views

gsoverview

Cuisine
22. 01. 2008
0 views

Cuisine

schap011
07. 02. 2008
0 views

schap011

Frontier1
11. 02. 2008
0 views

Frontier1

resiliency
09. 01. 2008
0 views

resiliency

library orientation
28. 01. 2008
0 views

library orientation

WeddingPlanning
29. 01. 2008
0 views

WeddingPlanning

harpring
21. 01. 2008
0 views

harpring

EnabGrid
07. 02. 2008
0 views

EnabGrid

owen holland
12. 01. 2008
0 views

owen holland

breakout 2ARavishankara
20. 02. 2008
0 views

breakout 2ARavishankara

Michelozzo and Bernardo
10. 01. 2008
0 views

Michelozzo and Bernardo

absent
15. 01. 2008
0 views

absent

p1 calyon de dumast
28. 02. 2008
0 views

p1 calyon de dumast

p548 lecture2v2
03. 03. 2008
0 views

p548 lecture2v2

SB 18 Productive Consultation
08. 03. 2008
0 views

SB 18 Productive Consultation

tortola
20. 01. 2008
0 views

tortola

ONEPowerPointPresent ation
19. 03. 2008
0 views

ONEPowerPointPresent ation

hall peter
25. 03. 2008
0 views

hall peter

EID Intro
31. 03. 2008
0 views

EID Intro

cottrell icfa korea may05
03. 04. 2008
0 views

cottrell icfa korea may05

Maps
07. 04. 2008
0 views

Maps

ErgonomicsPresentati on 000
07. 03. 2008
0 views

ErgonomicsPresentati on 000

London2012
14. 04. 2008
0 views

London2012

Samurai Hoedown
07. 02. 2008
0 views

Samurai Hoedown

m2f2
04. 02. 2008
0 views

m2f2

Olympic Mascots
14. 04. 2008
0 views

Olympic Mascots

stdslides2003
12. 03. 2008
0 views

stdslides2003

Packaging ru
14. 01. 2008
0 views

Packaging ru

phpulsefeb
14. 02. 2008
0 views

phpulsefeb

ALADI May2 2005
25. 01. 2008
0 views

ALADI May2 2005

041014 TEAHA
10. 04. 2008
0 views

041014 TEAHA

tds gap
22. 01. 2008
0 views

tds gap

AIDS f06
16. 01. 2008
0 views

AIDS f06

UniversityForumFeb23 2005
16. 01. 2008
0 views

UniversityForumFeb23 2005

Presentation to LGA 23Jan07 V3
24. 01. 2008
0 views

Presentation to LGA 23Jan07 V3

NW web presentation7 03
29. 02. 2008
0 views

NW web presentation7 03

build ssp system
21. 01. 2008
0 views

build ssp system

laighside
29. 01. 2008
0 views

laighside

landis
15. 01. 2008
0 views

landis

Service design for active ageing
21. 11. 2016
0 views

Service design for active ageing