• Japanese
  • Korean
  • Chinese
Cover Image

Automated Test & Verification Tools: 2012 Software & System Lifecycle Management Tools Market Intelligence

Connectivity and cost control are growing concerns impacting software development

The complexity of today's embedded devices and systems has escalated accross all industries, coupled with a growing requirement for connectivity and mobility. According to VDC's 2012 Software and Systems Development Survey, 58% of embedded and enterprise/IT developers expect their projects to require some form of web connectivity within the next two years. This growing interconnectivity with other devices and support systems forces requirements and resources into consideration fortheir designs, as well as heightening the concern and potential impact of security vulnerabilities.

Meanwhile, global market pressures to develop and introduce products quickly while controlling costs continue unabated. The pressure to deliver more advances, faster, opens the door for increased risk of software defects that impact quality and security. This scenario is ever more critical given the clear trend for software to account for a greater proportion of functionality, emerging as the primary agent for Model-based software testing differentiation and resource investment for tools many organizations.

Note: Percentages sum to over 100% due to multiple responses and not all responses options depicted above.

Respondents to our 2012 Software and Systems Development Survey reported their organizations:

  • Spend over 40% of their total project development costs on software engineering and tools, and;
  • Attribute greater percentage of end product/project value to software (36%), than to silicon (25%) or mechanical (23%) components on their current project.

Strategic Issues, Drivers & Trends

Impact on quality the most important selection criteria for static analysis, dynamic, and model-based test tools

Most Important Factor in Selecting ATVT Used on Current Project,
Segmented ByTestTool Type

(Percent of Respondents)

Development Pressures Encourage ATVT Use

Automated test and verification tools (ATVT) have emerged as one of the methods increasingly depended upon to ensure alignment to regulatory or internal process requirements and to catch errors or vulnerabilities earlier in the development lifecycle.

  • Organizations are held responsible forthe overall quality of their end product, including components received from outside sources. It is no surprise then, that respondents to VDC's 2012 Software and System Development Survey commonly selected “Impact on Quality” as the most important selection criteria for Static, Dynamic, and Model-based test tools.

With the acceleration of software content growth expected to persist, we believe that the evaluation and adoption of ATVT will increasingly be regarded as critical for quality assurance and as an important instrument for remaining competitive. The potential costs for software defects in embedded devices, especially those in safety critical applications, are too severe to leave addressed by manual processes or chance.

Market Segmentation, Estimates & Forecasts

Finding defects earlier in the development lifecycle a key benefit to ATVT use

VDC's research verifies that automated testing tool use increases the frequency of defect detection in current projects. More importantly, the findings confirm that engineers using testing tools are more likely to find vulnerabilities and defects earlier in the development cycle than nonusers of the tools.

Our research demonstrates engineering groups are using static analysis tools more frequently earlier in the development process than traditional manual or dynamic tests are typically executed. The results of Development Survey imply engineers recognize that static analysis tools can be effective at ensuring that software validation takes place as early in the lifecycle as possible, thereby reducing overall development costs.

We believe tool suppliers should promote overall development process rather than trying to replace traditional QA or security audit testing processes and tools. By supplementing testing methods already in place with a technology that helps find and fix defects early in development during the coding phase, the QA and security audit processes become more effective and efficient.

About the Team

Chris Rommel, Vice President.

Steve Balacco, Director.

André Girard, Senior Analyst.

Jared Weiner, Analyst.

Table of Contents

Critical Takeaways

  • Page 9. Automated Test & Verification Tools
  • Page 10. Automated Test & Verification Tools
  • Page 11. Automated Test & Verification Tools

Implications for Vendors

  • Page 13. Vendors honing cross-domain engineering integration approaches
  • Page 14. Tool purchase decisions moving up the organizational hierarchy
  • Page 15. No safety without security

Scope & Methodology

  • Page 17. Scope
  • Page 18. Scope
  • Page 19. Methodology

Market Definitions & Segmentation

  • Page 21. Software & Systems Lifecycle Management research
  • Page 22. Definitions
  • Page 23. Definitions
  • Page 24. Definitions
  • Page 25. Definitions

Market Overview

  • Page 27. Connectivity and cost control are growing concerns impacting software development
  • Page 28. Software an increasingly critical component of organizational differentiation and corporate profitability

Strategic Issues, Drivers & Trends

  • Page 30. Impact on quality the most important selection criteria for static analysis, dynamic, and model-based test tools
  • Page 31. Process mandates drive ATVT usage
  • Page 32. Testing tool use influencing timing and frequency of defect detection
  • Page 33. Finding defects earlier in the development lifecycle a key benefit to ATVT use
  • Page 34. Outsourcing/globally distributed impacting need for testing solutions
  • Page 35. Enterprise organizations seek to reduce their portfolio of managed tools
  • Page 36. Mobility requirements driving convergence
  • Page 37. Growing interest in Cross-Domain Integration
  • Page 38. Engineering domain integration next goal for greater automation synergies
  • Page 39. Collaboration needs drive SaaS/Cloud-based tool use
  • Page 40. Cloud/SaaS offerings increasingly considered
  • Page 41. A range of benefits and challenges to attributed to Agile/iterative design methodologies by ATVT users
  • Page 42. Agile methodology adoption rates vary
  • Page 43. Growing diversity of code sources and hardware architectures to drive need for test tools
  • Page 44. Drivers/inhibitors to commercial market for automated test and verification tools

Market Estimates & Forecasts

  • Page 46. Process compliance and time to market pressures impacting need for testing solutions
  • Page 47. Strong growth forecast for both static and dynamic test tools in embedded
  • Page 48. Enterprise testing spend dominated by dynamic and model-based test tool revenues
  • Page 49. Product category analysis, embedded automated test and verification tools
  • Page 50. Embedded and Enterprise ATVT suppliers challenged to develop profitable services strategies
  • Page 51. Product category analysis, embedded automated test and verification tools
  • Page 52. Service networks becoming increasingly important to tool vendors in Enterprise/IT
  • Page 53. Mobility is fueling an embedded and enterprise/IT convergence
  • Page 54. Product category analysis, enterprise / IT automated test and verification tools
  • Page 55. Geographic region analysis, automated test and verification tools
  • Page 56. Strong revenue growth in all regions for embedded test tools
  • Page 57. Geographic region analysis, embedded automated test & verification tools
  • Page 58. Geographic region analysis, enterprise automated test and verification tools
  • Page 59. Enterprise regional segmentation
  • Page 60. Geographic region analysis, enterprise / IT automated test and verification tools
  • Page 61. Complexity and connectivity drive commercial spending on ATVT tools
  • Page 62. Vertical market analysis, embedded automated test and verification tools
  • Page 63. Process standards spurring static analysis tool use in several verticals
  • Page 64. Vertical market analysis, embedded static analysis tools
  • Page 65. Compliance and connectivity drive dynamic and model-based test revenues
  • Page 66. Vertical market analysis, embedded dynamic and model-based test tools

Competitive Analysis & Position

  • Page 68. Embedded market offers more competition and opportunity for small vendors
  • Page 69. Coverity and MathWorks are market share leaders in the embedded static and dynamic test tool markets
  • Page 70. Coverity sees strong growth in multiple segments
  • Page 71. IBM and LDRA marketing broad solutions offerings
  • Page 72. Strong end of year for Klocwork in 2011
  • Page 73. Convergence and automated testing influencing ATVT purchasing decisions
  • Page 74. HP dominating enterprise/IT market share, generating almost 70% of worldwide revenue
  • Page 75. IBM and Parasoft lead ATVT vendors competing in both enterprise/IT dynamic and static analysis tool markets
  • Page 76. HP extends market leading position
  • Page 77. Expansion of testing in medical and telecommunications fuels solution sales
  • Page 78. QA Systems acquires Information Processing Ltd (IPL)
  • Page 79. Other leading test and automation tool vendors

LIST OF EXHIBITS

Automotive/Rail/Transportation

  • Exhibit VII-1: Worldwide Shipments of Embedded Software/System Automated Test and Verification Tools and Related Services Through 2014 (Millions of Dollars)
  • Exhibit VII-2: Worldwide Shipments of Embedded Software/System Static Analysis Tools and Related Services Through 2014 (Millions of Dollars)
  • Exhibit VII-3: Worldwide Shipments of Embedded Software/System Dynamic and Model-based Test Tools and Related Services Through 2014 (Millions of Dollars)
  • Exhibit VII-4: Worldwide Shipments of Embedded Software/System Automated Test and Verification Tools and Related Services, Segmented by Product Category (Percent of Dollars)
  • Exhibit VII-5: Worldwide Shipments of Embedded Software/System Automated Test and Verification Tools and Related Services, Segmented by Product Category; 2011-2014 (Millions of Dollars)
  • Exhibit VII-6: Worldwide Shipments of Embedded Software/System Static Analysis Tools and Related Services, Segmented by Product Category (Percent of Dollars)
  • Exhibit VII-7: Worldwide Shipments of Embedded Software/System Static Analysis Tools and Related Services, Segmented by Product Category; 2011-2014 (Millions of Dollars)
  • Exhibit VII-8: Worldwide Shipments of Embedded Software/System Dynamic and Model-based Test Tools and Related Services, Segmented by Product Category (Percent of Dollars)
  • Exhibit VII-9: Worldwide Shipments of Embedded Software/System Dynamic and Model-based Test Tools and Related Services, Segmented by Product Category; 2011-2014 (Millions of Dollars)
  • Exhibit VII-10: Worldwide Shipments of Embedded Software/System Automated Test and Verification Tools and Related Services, Segmented by Geographic Region (Percent of Dollars)
  • Exhibit VII-11: Worldwide Shipments of Embedded Software/System Automated Test and Verification Tools and Related Services, Segmented by Geographic Region; 2011-2014 (Millions of Dollars)
  • Exhibit VII-12: Worldwide Shipments of Embedded Software/System Static Analysis Tools and Related Services, Segmented by Geographic Region (Percent of Dollars)
  • Exhibit VII-13: Worldwide Shipments of Embedded Software/System Static Analysis Tools and Related Services, Segmented by Geographic Region; 2011-2014 (Millions of Dollars)
  • Exhibit VII-14: Worldwide Shipments of Embedded Software/System Dynamic and Model-based Test Tools and Related Services, Segmented by Geographic Region (Percent of Dollars)
  • Exhibit VII-15: Worldwide Shipments of Embedded Software/System Dynamic and Model-based Test Tools and Related Services, Segmented by Geographic Region; 2011-2014 (Millions of Dollars)
  • Exhibit VII-16: Worldwide Shipments of Embedded Software/System Automated Test and Verification Tools and Related Services, Segmented by Vertical Market (Percent of Dollars)
  • Exhibit VII-17: Worldwide Shipments of Embedded Software/System Automated Test and Verification Tools Segmented by Vertical Market; 2011-2014 (Millions of Dollars)
  • Exhibit VII-18: Worldwide Shipments of Embedded Software/System Static Analysis Tools and Related Services, Segmented by Vertical Market (Percent of Dollars)
  • Exhibit VII-19: Worldwide Shipments of Embedded Software/System Static Analysis Tools Segmented by Vertical Market; 2011-2014 (Millions of Dollars)
  • Exhibit VII-20: Worldwide Shipments of Embedded Software/System Dynamic and Model-based Test Tools and Related Services, Segmented by Vertical Market (Percent of Dollars)
  • Exhibit VII-21: Worldwide Shipments of Embedded Software/System Dynamic and Model-based Test Tools Segmented by Vertical Market; 2011-2014 (Millions of Dollars)
  • Exhibit VIII-1: Worldwide Shipments of Embedded Software/System Automated Test and Verification Tools Segmented by Leading Vendors (Percent of Dollars)
  • Exhibit VIII-2: Worldwide Shipments of Embedded Software/System Static Analysis Tools Segmented by Leading Vendors (Percent of Dollars)
  • Exhibit VIII-3: Worldwide Shipments of Embedded Software/System Dynamic and Model-based Test Tools Segmented by Leading Vendors (Percent of Dollars)

Enterprise

  • Exhibit V-1: Worldwide Shipments of Enterprise/IT Automated Test and Verification Tools and Related Services Through 2014 (Millions of Dollars)
  • Exhibit V-2: Worldwide Shipments of Enterprise/IT Static Analysis Tools and Related Services Through 2014 (Millions of Dollars)
  • Exhibit V-3: Worldwide Shipments of Enterprise/IT Dynamic and Model-based Test Tools and Related Services Through 2014 (Millions of Dollars)
  • Exhibit V-3: Worldwide Shipments of Enterprise/IT Automated Test and Verification Tools and Related Services, Segmented by Product Category (Percent of Dollars)
  • Exhibit V-4: Worldwide Shipments of Enterprise/IT Automated Test and Verification Tools and Related Services, Segmented by Product Category; 2011-2014 (Millions of Dollars)
  • Exhibit V-5: Worldwide Shipments of Enterprise/IT Static Analysis Tools and Related Services, Segmented by Product Category (Percent of Dollars)
  • Exhibit V-6: Worldwide Shipments of Enterprise/IT Static Analysis Tools and Related Services, Segmented by Product Category; 2011- 2014 (Millions of Dollars)
  • Exhibit V-7: Worldwide Shipments of Enterprise/IT Dynamic and Model-based Test Tools and Related Services, Segmented by Product Category (Percent of Dollars)
  • Exhibit V-8: Worldwide Shipments of Enterprise/IT Dynamic and Model-based Test Tools and Related Services, Segmented by Product Category; 2011-2014 (Millions of Dollars)
  • Exhibit V-9: Worldwide Shipments of Enterprise/IT Automated Test and Verification Tools and Related Services, Segmented by Geographic Region (Percent of Dollars)
  • Exhibit V-10: Worldwide Shipments of Enterprise/IT Automated Test and Verification Tools and Related Services, Segmented by Geographic Region; 2011-2014 (Millions of Dollars)
  • Exhibit V-11: Worldwide Shipments of Enterprise/IT Static Analysis Tools and Related Services, Segmented by Geographic Region (Percent of Dollars)
  • Exhibit V-12: Worldwide Shipments of Enterprise/IT Static Analysis Tools and Related Services, Segmented by Geographic Region; 2011- 2014 (Millions of Dollars)
  • Exhibit V-13: Worldwide Shipments of Enterprise/IT Dynamic and Model-based Test Tools and Related Services, Segmented by Geographic Region (Percent of Dollars)
  • Exhibit V-14: Worldwide Shipments of Enterprise/IT Dynamic and Model-based Test Tools and Related Services, Segmented by Geographic Region; 2011-2014 (Millions of Dollars)
  • Exhibit VI-1: Worldwide Shipments of Enterprise/IT Automated Test and Verification Tools Segmented by Leading Vendors (Percent of Dollars)
  • Exhibit VI-2: Worldwide Shipments of Enterprise/IT Static Analysis Tools Segmented by Leading Vendors (Percent of Dollars)
  • Exhibit VI-3: Worldwide Shipments of Enterprise/IT Dynamic and Model-based Test Tools Segmented by Leading Vendors (Percent of Dollars)
Show More
Pricing