The Future of Software Analysis and Measurement : Expert Panel Questions & Answers

Here are some of the questions that were answered after the webinar with Bill Curtis, David Herron, and Dan Galorath.  They were answered on Cast software’s Facebook page.

What about aerospace component level software and how would you apply a cost factor their  complexity factors?

Daniel Galorath The way we do this in SEER is to apply people, process, technology, complexity, and constraints to the components.   SEER would then output the cost.

What is IFPUG Back Fired Points, how does it help?

Daniel Galorath Backfiring  means counting lines of code then using a number of lines per function point to approximate function points.  I think it is much better than nothing for a finger in the wind.  Many others in the industry object strongly to it.

Another question – What type of information is needed to start using a software analysis and measurement tool?

Bill Curtis First  you need to know how you want to use the results.  That will help you establish criteria for evaluating which of the various tools best meets your needs.  The Goal-Question-Metric paradigm is a good guide for determining what your measurement needs are.

Here’s  another question from the webinar – Would like to understand how we can  improve our ability to capture metrics (defect density either using effective loc and or functional point) for applications that rely heavily on database’s where the logic resides – e.g to map biz rules existing in table rows/columns etc?

Daniel Galorath Generally  you would count the work involved in building the database, not the entry of the data into the database itself. SEER will provide estimates of defect density, etc.  From my understanding CAST can provide measurement of this.

What  is the panel’s opinion on LLOC to FP translation such as QSM language by language table which they developed from their database.

Daniel Galorath While  lines of code do not translate into function points and most people object to “backfiring”  it does make sense to relate function points to  effective effort units.. that is effort that has not yet been adjusted for complexity, technology, constraints, etc.

Do you have to have a technology inventory?

Bill Curtis Having an inventory of the technologies you are supporting is a necessary first step in trying to reduce IT costs, since reducing the number of technologies may be a critical issue. Even when organization has tools that allow easy entry of effort the developer/tester/reviewer doesn’t want to spend time to enter the data – this is a culture thing or motivation (understands value in collecting the data) In some environments it is required by law (government contracting). If developers don’t collect accurate effort data, they will always be subject to effort estimates that dramatically underestimate the time that the work will actually require. It is in developers best interest to record accurate effort data.

How do you extend the IT governance to software suppliers? what requirements to pose to them?

Bill Curtis Customers are starting to write measurable quality targets such as robustness or security targets into their outsourcing contracts as the equivalent of service level agreements. They then establish a Quality Gate where all software received is measured and evaluated before being put in operation. If the supplier’s software falls below the quality target they must remediate the code or face a financial penalty.

 

Thank you for reading “Dan on Estimating”, if you would like more information about Galorath’s estimation models, please visit our contact page, call us at +1 310 414-3222 or click a button below to ask sales questions, sign up for our free library or schedule a demo.




Software Project Monitoring & Control

February 28, 2011 · Filed Under earned value, Estimating, Software Estimating · Comment 

Galorath’s Dr. Denton Tarbet offers thoughts on Project Monitoring & Control:

Galorath’s SEER SEM with Project Monitoring & Control (PMC) option provides a simple tool to overcome the schedule prediction shortcomings of traditional Earned Value Management (EVM) methods.   In particular since EVM expresses project performance in terms of cost, the method loses the predictability of evaluating schedule at complete (Schedule EAC).  As Walt Lipke Points out[i], “Eventually all budget will be earned as the work is completed, no matter how late you finish.  The Schedule Variance improves as the project progresses and ends up with $0 variance at the end of the project.”  Recall that SV = BCWP – BCWS which by definition will be 0 at the end of the project and the SPI will be 1.0.

To overcome that issue it is necessary to develop an earned schedule concept, with some additional effort.  In lieu of adding effort to the EVM process, simply incorporating the EVM metrics as snapshots of project performance into the SEER PMC tool using the project model developed for the initial project estimates provides output that parallels the EVM output for cost and schedule, but the value of the schedule projections is retained throughout the project. PMC forecasts a realistic schedule variance from plan in terms of schedule metrics which is calibrated to reflect the actual accomplishments.  In addition, it can be demonstrated that PMC provides the project control feedback to project management to provide a method to evaluate alternative options designed to improve project performance in an attempt to improve project schedule performance.

Robert Hunt, et al provides a relevant discussion of EVM on software intensive projects[ii].  Additional white papers and referenced articles on the Galorath website provide more detailed discussion related to using  SEER SEM and PMC to develop and manage a successful software intensive project[iii].

[i] www.earnedschedule.com/Docs/ES%20-%20an%20extension%20to%20EVM%20EVA-10%202005%20Lipke

[ii] Data & Analysis Center for Software (DACS) Software Tech News –EVM issue (Volume 12, No. 1) DACS Software Tech News

[iii] http://www.galorath.com/search_results.html?q=EVM&cx=016648429445878925337%3Ajnoaofuymoe&cof=FORID%3A11&sa=Search#1304

Thank you for reading “Dan on Estimating”, if you would like more information about Galorath’s estimation models, please visit our contact page, call us at +1 310 414-3222 or click a button below to ask sales questions, sign up for our free library or schedule a demo.




Controlling Software Projects: Development Is Only Job One: Chicago SPIN Nov 12 2009

Dan will be speaking at the Chicago SPIN on November 12, 2009 on the topic of controlling software projects.  Estimation, planning, control, metrics, and maintenance for a total ownership cost view will be discussed.

The presentation is here: Chicago SPIN November 2009 Galorath Presentation Controlling Software Projects Development Is Only Job 1

PS Dan looks forward to his short visit to Chicago, his home town.  And is going to carefully avoid pizza, hot dogs, and Italian beef while he is there.

The flyer follows:

Read more

Thank you for reading “Dan on Estimating”, if you would like more information about Galorath’s estimation models, please visit our contact page, call us at +1 310 414-3222 or click a button below to ask sales questions, sign up for our free library or schedule a demo.




Improving Earned Value With Statistics

September 21, 2009 · Filed Under Cost Estimating, earned value · Comment 

I attended a very interesting session presented by Eric Druker and Dan Demangos of Booz Allen Hamilton and Richard Coleman of Northrop Grumman Information Systems, at the Department of the Navy Cost Analysis Symposium (DONCAS) last week covering improving Earned Value (EVM) analysis with statistics.  The speakers covered many of the common points regarding EVM weaknesses and showed some work they had done in helping solve some of these issues.

I found it interesting that SEER-SEM’s Parametric Progress analysis solves the same problems by looking at EVM type data and parametrics in concert.

The Problem Statement from the briefing included:

  • Currently, the traditional Earned Value Management calculations suffer from several shortcomings that lessen their viability as a cost estimating tool

Read more

Thank you for reading “Dan on Estimating”, if you would like more information about Galorath’s estimation models, please visit our contact page, call us at +1 310 414-3222 or click a button below to ask sales questions, sign up for our free library or schedule a demo.




The Sooner You Fall Behind, The More Time You Have To Catch Up

August 7, 2009 · Filed Under CEO, earned value, Estimating, General · Comment 

I received an email from the Josephson Institute of Ethics today that included this quote from a well known comedian: “The Sooner You Fall Behind, The More Time You Have To Catch Up.”

As I pondered the absurdity of the statement my mind focused on the many projects I have seen where this might have been taken seriously.  I recall, many years ago, preparing an estimate for a new project, an in-house typesetting system.  While this was not the most complicated software in the world, it took a lot at that time to do a decent job of typesetting with hyphenation, justification, kerning, leading, etc. all having to be implemented by hand generated code (how big is Knuth’s TEX  application?).  The customer had received a proposal from a trusted supplier (who did business reporting software) to build an entire system in just months.  When confronted with the implausibility, the vendor’s only response was, “I just know I can do this.”   Thank goodness the customer didn’t go for it.  If they had, what would have happened… After the original target day came and went there would have been a flurry… a descoping… more promises that “we are almost done, I just know it”… and after a year or two the project would probably have been canceled.

I recall another time, very early in my career… before parametric estimating, when we had a 4 terminal cluster system to develop.  We had a functional spec and a (probably poor) estimate.  We saw an ad in a computer magazine that said this particular programming language would cut costs to 10%.  The supplier came out and guaranteed it: even bidding fixed price and just a few weeks for the entire job.  I must admit I wondered how the vendor would do it… an assembly line type of setup where a team would pass information and where a chief programmer would allocate tasks or what.  When the big day came one guy showed up.  He worked about 24/7. The deadline came and went.  Still no worries… it was the world’s answer to software and it was fixed price.  Six months came and went. Now the vendor came in and said they couldn’t do it.  Four employees plus the vendor and 5 months later it was complete.

I have heard it said that if a cost performance index was below .95 or so, the project cannot catch up.  While no one wants their projects to be in trouble, isn’t it valuable to understand what you can’t catch up?

Viable plans help make successful projects.

Thank you for reading “Dan on Estimating”, if you would like more information about Galorath’s estimation models, please visit our contact page, call us at +1 310 414-3222 or click a button below to ask sales questions, sign up for our free library or schedule a demo.




Final Version of the GAO Cost Guide

It appears that this is the final version of the GAO cost estimating guide which provides guidance on preparing viable cost estimates both early in the process and throughout the life cycle. Congratulations to the team.  This is a great contribution to the industry and can, if used as intended create more successful projects.  I especially appreciate the focus on preparing a viable estimate of cost, schedule, etc. then applying earned value management (EVM) to that. So often, in the past we have seen a chasm between those that generated estimates and the EVM people.  These are two sides of the same coin.  The introduction follows:

Read more

Thank you for reading “Dan on Estimating”, if you would like more information about Galorath’s estimation models, please visit our contact page, call us at +1 310 414-3222 or click a button below to ask sales questions, sign up for our free library or schedule a demo.




Applying Earned Value Management to Software Intensive Programs Part 4

April 19, 2009 · Filed Under earned value · Comment 

For paper with figures see Applying Earned Value Management To Software Intensive Programs Final   This article was originally published in the Software Tech News, Volume 12, No. 1, April 2009.  The web site for more information about this publication is www.softwaretechnews.com  This paper illustrates how to achieve more successful projects with estimation, planning and control.  Cost estimating as well as effort, schedule, and risk are included with illustrations from SEER for Software (SEER-SEM)

Using an analytic process to project cost and schedule based on actual performance

  Read more

Thank you for reading “Dan on Estimating”, if you would like more information about Galorath’s estimation models, please visit our contact page, call us at +1 310 414-3222 or click a button below to ask sales questions, sign up for our free library or schedule a demo.




Galorath Article “Applying Earned Value Management To Software Intensive Programs Part 2

April 15, 2009 · Filed Under earned value · Comment 

For paper with figures see Applying Earned Value Management To Software Intensive Programs Final

Establishing a Process for Requirements Definition and Developing the Technical, Cost and Schedule Baselines

A software program life cycle cost estimate is the most knowledgeable statement one can make at a particular point in time regarding effort/cost, schedule, staffing, risk, and reliability.

However, the most important business decisions about a software project are often made at the time of minimum knowledge and maximum uncertainty.   Cost estimators recognize that the estimate is not a point, but rather a well formed estimate defined by a probability distribution.

Read more

Thank you for reading “Dan on Estimating”, if you would like more information about Galorath’s estimation models, please visit our contact page, call us at +1 310 414-3222 or click a button below to ask sales questions, sign up for our free library or schedule a demo.




Galorath Article “applying Earned Value Management To Software Intensive Programs Part 1

April 13, 2009 · Filed Under earned value · Comment 

The new Galorath paper on performance based earned value went live on the DACS site today.� It is so important to have viable estimates as the basis of plans for earned value to be valuable.� For paper with figures see Applying Earned Value Management To Software Intensive Programs Final� The paper’s introduction follows:

Read more

Thank you for reading “Dan on Estimating”, if you would like more information about Galorath’s estimation models, please visit our contact page, call us at +1 310 414-3222 or click a button below to ask sales questions, sign up for our free library or schedule a demo.