Center for Systems and Software Engineering

Annual Research Review 2024

Swipe to check out the most current presentation details. Should you require any assistance or additional information during the forum, reach out to us at

Date: April 16, 2023 – April 18, 2024
Time: 8:00 am – 2:00 pm PT (11:00 am – 5:00 pm ET)

We're sorry, but all tickets sales have ended because the event is expired.

Program Schedule

All times in Pacific Time (PT)
Tuesday, April 16
8:00 Conference Intro by Jim Alstad   
8:05 Overview of Boehm CSSE by Brad Clark   
8:10 Technical Content by Arlene Minkiewicz
(30 mins)

Leveraging Systems Thinking in Business Process Design by Rick Hefner

The Systems Engineering (SE) methodology can be used to address the commonalities in structuring, analyzing, and optimizing systems, regardless of whether they pertain to physical products or operational workflows. This presentation examines the application of systems thinking principles to the design and optimization of business processes, facilitating a comprehensive understanding of the organizational dynamics; enabling the identification of inefficiencies, bottlenecks and opportunities for improvement.

(30 mins)

Keynote: Transdisciplinary Systems Engineering: A New Mindset for 21ST Century Engineering by Azad Madni

9:30 Break
(30 mins)

The Convergence of COSYSMO with Model Based Systems Engineering by Barry Papke

This presentation describes research on the convergence of COSYSMO and Model Based Systems Engineering (MBSE). Topics presented will include updated COSYSMO counting rules incorporating reuse information for driver size selection and assignment in the SySML model, development of a COSYSMO profile, implemented within CATIA Magic Systems of Systems Architecture .

(30 mins)

AI Assisted MBSE (AIM Process) by Doug Rosenberg

This presentation highlights the significance of software in system specifications and introduces an approach by using Artificial Intelligence (AI) as a subject matter expert. The presentation sheds the light on the overlooked, yet crucial, role of software in SysML and MBSE and steps into the future where Artificial Intelligence (AI) as not just a tool but a collaborator in systems engineering.

11:20 Break
(60 mins)

Keynote: Health Care as a Systems Engineering Opportunity by Neil Siegel

Although healthcare has ‘discovered’ systems engineering, the techniques we all know so well have mostly be applied only “at the margins”. An in-progress activity is described that can provide an example of what systems engineering could do to benefit society.

13:00 Break
(30 mins)

Invited Paper: A State-based Probabilistic Risk Assessment Framework for System-of-systems Operations by Sonali Sinha Roy

In a System of Systems, Harel statecharts are used to model the individual systems. These are then connected with an SoS-level model that is used for stochastic analysis through Monte Carlo simulations.

Wednesday, April 17
(30 mins)

Keynote: Open Source Systems Modeling and Convergence with AI by Ray Madachy

(30 mins)

Baselining AI’s Systems Engineering Performance in Cost Modeling by Ryan Bell

In the rapidly evolving field of Artificial Intelligence (AI), Large Language Models (LLMs) have demonstrated unprecedented capabilities in understanding and generating language. This presentation introduces a component of SysEngBench, a novel benchmark specifically designed to evaluate LLMs in the context of systems engineering concepts and applications.

(30 mins)

Building and Modifying Systems Models with Gen AI by Ryan Longshore

As Artificial Intelligence (AI) continues to rapidly advance, Large Language Models (LLMs) have proven capable of not only interacting with humans using natural language, but writing and modifying software code. This presentation focuses on utilizing different techniques such as zero shot and few shot learning to build and model SysML v2 models.

10:00 Break
(45 mins)

Keynote: The Future of Systems Engineering by Ralf Hartmann

The presentation will introduce the FuSE (Future of Systems Engineering) initiative of INCOSE, summarize the achievements from 2023, and outline the plans for 2024 and beyond.

(30 mins)

Research on Challenges for Integating Measurement and Control Mechanisms into Engineered Systems Viewed through the Prism of Future Systems by Ken Nidiffer

Fundamental shifts in software and system engineering are taking place in government, academia, and industry to ensure technological superiority. This presentation addresses systems engineering challenges for integration measurement and control mechanisms into future systems throughout the system acquisition lifecycle. Its focus is on one of the National Defense Modernizations Priorities, Cyber Security.

12:05 Break
(30 mins)

Digital Engineering – Is it any better? by Cheryl Jones

Digital Engineering (DE) represents a paradigm shift in the way system and software engineering is conducted, leveraging digital technologies to drive innovation, improve collaboration, and deliver higher-quality products and systems in less time and at reduced costs. The purpose of this presentation is to discuss the ongoing work that has occurred over the past years in defining measures that will be practical and useful in determining the benefits of DE.

(30 mins)

The Role of Cost in Digital Engineering by Allison Moeller

Enterprise and portfolio management strive to balance performance, strategic objectives, and resources across broad agency-wide systems of systems. This presentation will discuss the potential of cost estimating at the enterprise level within a digital environment to coordinate and balance priorities across portfolios of programs and projects with common objectives and requirements to meet their mission unique goals, and the importance of “getting data sources and structure right” from the onset of the DE revolution.

Thursday, April 18
(30 mins)

Keynote: Expanding the Systems Engineering tool box for sustainable industries by Cecilia Haskins

(30 mins)

Cultivating Effective DevSecOps Culture: Expectations and Preliminary Insights by Bill Nichols

DevSecOps (which integrates development, security and operations in an effort to address productivity and security) is a key implementation approach as part of the Department of Defense’s (DoD’s) Software Modernization Plan to modernize software development and reduce lead times. This ongoing study focuses on examining the processes and practices associated with the cultural factors to identify barriers and enablers to successful DevSecOps implementation.

(30 mins)

Causal Discovery at the SEI: A Seven Year perspective by Michael Konrad

The SEI has been applying Causal Discovery and Inference (CDi) in a variety of projects for the past 7 years in order to better understand causality with respect to the factors that drive software development costs, quality and security; the factors that drive systems engineering and success; and AI/ML classifier prediction accuracy robustness across various scenarios/edge cases. This presentation will define and make the case for increased use of CDI in systems and software engineering research practices and will address the broader lessons learned by the SEI across projects.

10:00 Break
(30 mins)

Unveiling the Power of Regression Trees and Random Forests in Software Maintenance Cost Prediction by Brad Clark

This presentation shows our results from exploring machine learning (ML) in analyzing software engineering cost data, using the Software Sustainment Initiative data set consisting of various software cost factors to train the models to predict total release hours. The resulting models will be evaluated against traditional cost estimating relationships presented at this and other forums, highlighting the potential of regression trees and random forests as effective tools for software cost estimation.

(60 mins)

Workshop: Towards Estimating Schedule for Systems Engineering Projects by Jim Alstad

12:10 Conference Closing by Jim Alstad   

Last Updated: 4/13/24 11:00

The Boehm Center for Systems and Software Engineering is hosting a 3-day online forum April 16-18. In keeping with Dr Boehm’s areas of interest, we are soliciting presentations from those in academia, industry, and government, especially from those involved in systems and software engineering.

Some possible topics are:

  • Generative AI
  • Data analytics
  • Digital Engineering
  • AI, Autonomous Systems
  • Systems Thinking as applied to business / organizational processes, particularly as related to technology and innovation
  • Topics related to quality of systems
  • Enterprise architecture, software processes
  • Software intensive systems
  • Software maintenance and quality
  • Innovative approaches to Cost Engineering
  • Moral and Ethical Boundaries of AI
  • Cybersecurity
  • Agile and DevOps Processes / Lessons Learned

As always, other topics related to cost modeling and estimation or to software or systems engineering processes are welcome. Presentations may cover work in progress and/or completed results.


Please submit a 1-3 paragraph abstract along with two author biographies: one consisting of 2 sentences for a brief introduction and another in paragraph form, to

Important Dates

March 14, 2024 Submit abstract and author biographies to
April 5, 2024 Authors notified of acceptance / rejection.
April 12, 2024 Authors provide full presentations to
April 16 – 18, 2024 Boehm CSSE Annual Research Review 2024.


This is an online meeting. The conference is free for presenters and for Boehm CSSE individual members and affiliates. For others, the participation fee is $50, which includes a one-year individual membership in Boehm CSSE. If you are a student, the registration fee is reduced; please contact For any general questions, please contact

We're sorry, but all tickets sales have ended because the event is expired.
  • Boehm CSSE Annual Research Review 2024
     April 16, 2024 – April 18, 2024
     8:00 am – 2:00 pm