Software Engineering (SE)
DCWF 673
Software Test & Evaluation Specialist
Plans, prepares, and performs testing, evaluation, verification, and validation of software to evaluate results against specifications, requirements, and operational need.
Tasks
The concrete work activities defined for this role in the DCWF v5.1 spreadsheet. Core tasks are required for the role; additional tasks are associated but not mandatory.
- T393A additional Administer test bed(s), and test and evaluate applications, hardware infrastructure, rules/signatures, access controls, and configurations of platforms managed by service provider(s).
- T412A additional Analyze the results of software, hardware, or interoperability testing.
- T414 additional Analyze user needs and software requirements to determine feasibility of design within time and cost constraints.
- T431A additional Build, assess, and modify product prototypes using working models or theoretical models.
- T452 additional Conduct functional and connectivity testing to ensure continuing operability.
- T508 additional Determine level of assurance of developed capabilities based on test results.
- T515A additional Develop software system testing and validation procedures, programming, and documentation.
- T550 additional Develop test plans to address specifications and requirements.
- T5650 additional Validate specifications and requirements for testability.
- T5866A additional Create or customize existing Test and Evaluation Master Plans (TEMPs) for systems.
- T5877A additional Develop possible solutions for technical risks and limitations of planned tests.
- T5910A additional Provide quality assurance of software products throughout their lifecycle.
- T5914 additional Report test and evaluation deficiencies and possible solutions to appropriate personnel.
- T5920A additional Test components to ensure they work as intended in a variety of scenarios for all aspects of the application.
- T5933 additional Conduct automated testing for acceptance testing, functional testing, integration testing, interoperability testing, load/stress testing, performance testing, regression testing, and unit testing.
- T5934 additional Develop and maintain a tool framework for automated test and evaluation.
- T5935 additional Perform usability surveys on operators/users of the system.
- T5936 additional Evaluate reliability, availability, and maintainability data.
- T5937 additional Assess the system’s effectiveness and suitability for meeting user need and based on test and evaluation results.
- T5938 additional Integrate digital engineering models and data into test designs.
- T694 additional Make recommendations based on test results.
- T748A additional Perform developmental testing on systems under development.
- T757A additional Perform interoperability testing on systems exchanging electronic information with other systems.
- T761A additional Perform operational testing.
- T858A additional Test, evaluate, and verify hardware and/or software to determine compliance with defined specifications and requirements.
- T858B additional Record and manage test data.
- T874 additional Utilize models and simulations to analyze or predict system performance under different operating conditions.
- T951 additional Determine scope, infrastructure, resources, and data sample size to ensure system requirements are adequately demonstrated.
Knowledge, Skills, and Abilities
KSA statements define what a person filling this role knows or can do. "Knowledge" is what they must know, "Skill" is what they can perform, and "Ability" is a durable capacity they bring to the work.
- A6020 ability core Ability to analyze test data.
- A6060 ability core Ability to collect, verify, and validate test data.
- A6170 ability core Ability to translate data and test results into evaluative conclusions.
- A7086 ability core Ability to construct, maintain, and conduct testing in various test environments.
- K0016 knowledge core Knowledge of capabilities and requirements analysis.
- K0130 knowledge core Knowledge of virtualization technologies and virtual machine development and maintenance.
- K0144 knowledge core Knowledge of the systems engineering process.
- K130A knowledge core Knowledge of systems security testing and evaluation methods.
- K6430 knowledge core Knowledge of Test & Evaluation processes.
- K7003A knowledge core Knowledge of security risks, threats, and vulnerabilities and potential risk mitigation solutions.
- K7004A knowledge core Knowledge of Test & Evaluation frameworks.
- K7006A knowledge core Knowledge of best practices from industry and academia in test design activities for verification and validation of systems.
- K7025A knowledge core Knowledge of how software solutions integrate with cloud or other IT infrastructure.
- K7044 knowledge core Knowledge of testing, evaluation, validation, and verification (T&E V&V) tools and procedures to ensure systems are working as intended.
- K7054A knowledge core Knowledge of tools for testing the robustness and resilience of software products and solutions.
- K7085 knowledge core Knowledge of software environments (e.g., development, testing, integration, production, etc.) and appropriate T&E application in those environments.
- K978A knowledge core Knowledge of root cause analysis techniques.
- S1020A skill core Skill in secure test plan design (e. g. unit, integration, system, acceptance).
- S169 skill core Skill in conducting test events.
- S176 skill core Skill in designing a data analysis structure (i.e., the types of data your test must generate and how to analyze those data).
- S182 skill core Skill in determining an appropriate level of test rigor for a given system.
- S190 skill core Skill in developing operations-based testing scenarios.
- S220 skill core Skill in systems integration testing.
- S239 skill core Skill in writing test plans.
- S6530 skill core Skill in designing and documenting overall program Test & Evaluation strategies.
- S6630 skill core Skill in preparing Test & Evaluation reports.
- S7077A skill core Skill in translating operation requirements for systems into testing requirements.
- S950 skill core Skill in evaluating test plans for applicability and completeness.
- A7083 ability additional Ability to measure human systems interaction (usability, workload, system trust).
- A7084 ability additional Ability to evaluate user training and documentation update processes.
- K0040 knowledge additional Knowledge of organization's evaluation and validation requirements.
- K0053 knowledge additional Knowledge of measures or indicators of system performance and availability.
- K0083 knowledge additional Knowledge of network hardware devices and functions.
- K081A knowledge additional Knowledge of network protocols such as TCP/IP, Dynamic Host Configuration, Domain Name System (DNS), and directory services.
- K0904 knowledge additional Knowledge of interpreted and compiled computer languages.
- K0965 knowledge additional Knowledge of organization's risk tolerance and/or risk management approach.
- K7009A knowledge additional Knowledge of coding and scripting in languages that support software development and use.
- K7012A knowledge additional Knowledge of current test standards and safety standards that are applicable to software development.
- K7028A knowledge additional Knowledge of how to automate development, testing, security, and deployment of software to the DoD.
- K7034A knowledge additional Knowledge of interactions and integration of DataOps, MLOps, and DevSecOps solution.
- K7036A knowledge additional Knowledge of laws, regulations, and policies related to software development, cybersecurity, data security/privacy, and use of publicly procured data for government.
- S238A skill additional Skill in writing code in a currently supported programming language (e.g., Java, C++).
- S6500 skill additional Skill in conducting Test Readiness Reviews.
- S6580 skill additional Skill in identifying Test & Evaluation infrastructure (people, ranges, tools, instrumentation) requirements.
- S6600 skill additional Skill in managing test assets, test resources, and test personnel to ensure effective completion of test events.
- S6641 skill additional Skill in providing Test & Evaluation resource estimate.
- S7070A skill additional Skill in integrating software Test & Evaluation frameworks into test strategies for specific projects.
- S980A skill additional Skill in performing root cause analysis.