CAREERS

DESCRIPTION:

Analyzes system requirements and concept of operations documents, acquisition plans, and system descriptions to develop evaluation and test plans and procedures, prepare for and conduct the data collection and analysis, and report status and results. Supports the development of Government test and evaluation documentation e.g., Test & Evaluation (T&E) Strategy, Test & Evaluation Master Plan, Event Test Plans, Test Readiness Assessments, and T&E Reports. Works with other test organizations to support T&E program integration. Provides specialized T&E capabilities tailored to system functions, level, maturity, and performance area as assigned in the SOW.

REQUIREMENTS:

• Assist with any or all of the Level 1 tasks as constrained by technical training and previous testing experience
• Conduct research into and apply knowledge of Government test and evaluation concepts and related engineering, acquisition, and operations activities as needed to support the T&E activities
• Plan and Execute Performance Analysis
• Review planned acquisition approaches to support T&E schedule alignment with decision maker needs for T&E support
• Analyze performance risk areas to focus T&E planning
• Specify, validate, and adapt Modeling and Simulation for T&E use
• Apply Statistical Analysis of variations in performance behavior to characterize confidence in performance estimates
• Select, develop, & use analysis tools
• Execute the evaluation plan on data collected by the Testing Tasks
• Plan and Execute Performance Data Collection
• Plan program and event level testing for collection of data required for analysis and to synch T&E events with supported decision points
• Establish and employ Data & Configuration Management capabilities
• Support Data Authentication group functions; and comply with program Discrepancy Reporting criteria and processes
• Assess operational and system performance requirements for testability and criticality to frame and prioritize T&E objectives and enable evaluation planning
• Coordinate with program Systems Engineering (SE) and review T&E-related SE information to leverage functional analysis, system descriptions, parameter selection and dependencies, Modeling and Simulation, and initial performance risk assessments to inform evaluation planning
• Assess operational environments and priorities for evaluation attention and scenario selection, and to coordinate user participation in T&E
• Plan program and event level risk-tailored performance estimation and analysis of system and operational Effectiveness and Suitability metrics & conditions; levels of T&E include inspection, demonstration, paper analysis, survey, simulation, and physical test
• Design surveys for evaluation of Subject Matter Expert (SME) input and user assessments of performance
• Participate in the T&E Working-level Integrated Product Team (WIPT) and/or Integrated Test Team for coordination of evaluation plans
• Produce Evaluation Plans (metric framework, scenarios/threads, timelines, requirements/T&E cross-walk), Analysis Plans, Data Requirements, Risk Assessments, Evaluation Reports, Status reports; provide input to Government T&E products (e.g., Technology Readiness Assessments, Test & Evaluation Strategy, Test & Evaluation Master Plan, T&E Plans & Procedures and Test Readiness Reports)
• Design data sampling schemes to optimize the information/resource balance and to control testing uncertainties
• Select, coordinate, and calibrate Instrumentation, collection and data management tools, targets, & facilities
• Ensure test readiness including training of test event participants re conduct of the event; equipment readiness, and security, legal, and privacy compliance arrangements
• Participate in T&E WIPT and/or Integrated Test Team for coordination of data collection plans
• Execute Testing and Data Collection per plan
• Produce associated Test Plans, Procedures, and Reports/Briefings, Data Management Plan
• Define and provide technical direction and guidance for the Level 1 tasks to the Level 0 and Level 1 TEs assigned to the task
• Recommend draft plans and reports from the Level 1 tasks for approval by the task leader
• Work directly with the Government sponsor to coordinate task implementation
• Maintain knowledge of current and evolving agency, national, and international standards applicable to the system development of interest

QUALIFICATIONS:

Five (5) years experience as a TE in programs and contracts of similar scope, type and complexity is required. Bachelor’s degree in Math, Science, Engineering, Statistics, Engineering Management, or related discipline from an accredited college or university is required. Four (4) years of additional TE experience may be substituted for a bachelor’s degree.

DESCRIPTION:

The candidate will join a team of developers developing a full-stack testing and packaging capability for a large-scale modular framework.

 REQUIREMENTS:

• In-depth experience in Testing and Evaluation (T&E)
• In-depth understanding of Computer Network Operations (CNO) tradecraft
• Experience with Python (pytest and/or unittest modules preferred)
• Experience creating virtual environments
• Ability to perform system level testing, evaluation, and related activities
• Ability to create, update, and maintain technical documentation
• Ability to perform basic software installation and operation tasks
• Ability to document test results including successes, failures, and deficiencies
• Experience communicating both orally and written on testing status to technical leads and customers

EDUCATION:

BA or BS from an accredited college or university in Math, Science, Engineering or Statistics, or related field is required. Five (5) years of additional TE experience may be substituted for a Bachelor’s Degree.

DESCRIPTION:

Looking for a well-rounded Test Engineer who will join a team of existing Test Engineers and be able to hit the ground running. A self-starter who can work well primarily independently but often in a group setting as well. The individual will wear multiple hats and as a result must be able to context switch and handle multiple assigned tasks simultaneously. The team is responsible for performance testing state of the art computing systems at a large scale 

REQUIRED EXPERIENCE: (Multiple Levels; minimum 2 years of experience)

• Five (5)+ years of experience as a Test Engineer
• Experience with system-level testing (hardware + software)
• Proficiency with Linux, standard Linux/Unix tools, and at least one scripting language (Python, Bash, Perl, etc.)
• Experience running performance benchmarks
• Effective interpersonal and teamwork skills
• Familiar with formal testing process.
• Familiar with issue tracking (JIRA) and generating test reports.

“NICE TO HAVE” EXPERIENCE:

• Knowledge of / experience with HPC applications and algorithms
• Experience with software / test automation
• Experience with computer architecture (compute, memory, storage)
• Experience with data analytics and reporting
• Knowledge of multi-threading / parallel programming libraries (MPI, pthreads, OpenMP, etc.)
• Knowledge of GPU-related software/libraries (CUDA, OpenCL, etc.)

EDUCATION:

BA or BS from an accredited college or university in Math, Science, Engineering or Statistics, or related field is required. Five (5) years of additional TE experience may be substituted for a Bachelors Degree.

DESCRIPTION:

Looking for a well-rounded Software Test Engineer who will join a team of existing Test Engineers and be able to hit the ground running. A self-starter who can work well primarily independently but often in a group setting as well. The individual will wear multiple hats and as a result must be able to context switch and handle multiple assigned tasks simultaneously. The team is responsible for performance testing state of the art (sometimes barely on the market) computing systems at a large scale and evaluating the tools (both products and Big Data analytics) built to run on these systems. The candidate would be responsible for working on one or both of these areas depending upon their skill sets with a strong desire for a suite of skills that include the latter. A strong understanding of the Software Development Life Cycle and Test Engineering Processes is required for this position. Below is a list of Skills and Technologies. It is required that any candidate have high levels of proficiency in at least half of the items listed in the Skills/Background Section.

REQUIRED EXPERIENCE:

• Strong understanding of the Software Development Life Cycle
• Strong understanding in Test Engineering processes
• Automated Software Engineering abilities (either as a SWE or TE)

SKILLS/BACKGROUND:

• Java
•  C
• Parallel Programming:
• MPI variations
• shmem variations
• Accumulo
• Maven
• Jira/Confluence
• Redhat/CentOS
• Bash Scripting
• REST API calls – manual or automated
• NiagaraFiles

REQUIREMENTS:

• Assist with any or all of the Level 1 tasks as constrained by technical training and previous testing experience
• Conduct research into and apply knowledge of Government test and evaluation concepts and related engineering, acquisition, and operations activities as needed to support the T&E activities
• Plan and Execute Performance Analysis
• Review planned acquisition approaches to support T&E schedule alignment with decision maker needs for T&E support
• Analyze performance risk areas to focus T&E planning
• Specify, validate, and adapt Modeling and Simulation for T&E use
• Apply Statistical Analysis of variations in performance behavior to characterize confidence in performance estimates
• Select, develop, & use analysis tools
• Execute the evaluation plan on data collected by the Testing Tasks
• Plan and Execute Performance Data Collection
• Plan program and event level testing for collection of data required for analysis and to synch T&E events with supported decision points
• Establish and employ Data & Configuration Management capabilities
• Support Data Authentication group functions; and comply with program Discrepancy Reporting criteria and processes
• Assess operational and system performance requirements for testability and criticality to frame and prioritize T&E objectives and enable evaluation planning
• Coordinate with program Systems Engineering (SE) and review T&E-related SE information to leverage functional analysis, system descriptions, parameter selection and dependencies, Modeling and Simulation, and initial performance risk assessments to inform evaluation planning
• Assess operational environments and priorities for evaluation attention and scenario selection, and to coordinate user participation in T&E
• Plan program and event level risk-tailored performance estimation and analysis of system and operational Effectiveness and Suitability metrics & conditions; levels of T&E include inspection, demonstration, paper analysis, survey, simulation, and physical test
• Design surveys for evaluation of Subject Matter Expert (SME) input and user assessments of performance
• Participate in the T&E Working-level Integrated Product Team (WIPT) and/or Integrated Test Team for coordination of evaluation plans
• Produce Evaluation Plans (metric framework, scenarios/threads, timelines, requirements/T&E cross-walk), Analysis Plans, Data Requirements, Risk Assessments, Evaluation Reports, Status reports; provide input to Government T&E products (e.g., Technology Readiness Assessments, Test & Evaluation Strategy, Test & Evaluation Master Plan, T&E Plans & Procedures and Test Readiness Reports)
• Design data sampling schemes to optimize the information/resource balance and to control testing uncertainties
• Select, coordinate, and calibrate Instrumentation, collection and data management tools, targets, & facilities
• Ensure test readiness including training of test event participants re conduct of the event; equipment readiness, and security, legal, and privacy compliance arrangements
• Participate in T&E WIPT and/or Integrated Test Team for coordination of data collection plans
• Execute Testing and Data Collection per plan
• Produce associated Test Plans, Procedures, and Reports/Briefings, Data Management Plan
• Define and provide technical direction and guidance for the Level 1 tasks to the Level 0 and Level 1 TEs assigned to the task
• Recommend draft plans and reports from the Level 1 tasks for approval by the task leader
• Work directly with the Government sponsor to coordinate task implementation
• Maintain knowledge of current and evolving agency, national, and international standards applicable to the system development of interest

LEVEL 3:

• Provide overall leadership of the T&E task and serve as primary liaison to the government for supporting contract coordination and task execution
• Communicate issues and solutions to the broader government and contract management structure as requested by Leadership
• Ensure the appropriate level of independence of the team from the solution provider to support government management of objectivity risk
• Manage T&E resources and tasks; ensure quality assurance of test processes and products
• Coordinate and integrate Evaluation and Testing tasks and products
• Participate in T&E WIPT and/or Integrated Test Team as needed to ensure proper coordination of T&E activities
• Drive innovation and responsiveness to program changes and evolving T&E status to help manage program risk: develop alternative courses of action, work-arounds, and fall-back positions with a recommended course of action for each risk, and monitor and re-evaluate risks at appropriate milestones

QUALIFICATIONS:

LEVEL 2:

Five (5) years experience as a TE in programs and contracts of similar scope, type and complexity is required. Bachelor’s degree in Math, Science, Engineering, Statistics, Engineering Management, or related discipline from an accredited college or university is required. Four (4) years of additional TE experience may be substituted for a bachelor’s degree.

LEVEL 3:

Eight (8) years experience as a TE in programs and contracts of similar scope, type and complexity is required. Bachelor’s degree in Math, Science, Engineering, Statistics, Engineering Management or related discipline from an accredited college or university is required. Four (4) years of additional TE experience may be substituted for a bachelor’s degree.

DESCRIPTION: 

The candidate will be required to perform software development in support of test engineers to ensure the systems under test meet all measured criteria. The candidate will be working as a team to support a larger organizational effort.

REQUIREMENTS:

• Experience communicating both orally and written on testing status to technical leads and customers
• Prior experience with major testing systems used internally required to make minor modifications and feature changes to suit specific testing requirements for this effort
• Experience developing Java, JavaScript, and Python code. Candidate will make modifications to an existing code-base that are custom tailored to this effort

DESCRIPTION: 

Tester Engineer analyzes system requirements and concept of operations documents, acquisition plans, and system descriptions to develop evaluation and test plans and procedures, prepare for and conduct the data collection and analysis, and report status and results. Supports the development of Government test and evaluation documentation e.g., Test & Evaluation (T&E) Strategy, Test & Evaluation Master Plan, Event Test Plans, Test Readiness Assessments, and T&E Reports. Works with other test organizations to support T&E program integration. Provides specialized T&E capabilities tailored to system functions, level, maturity, and performance areas. 

QUALIFICATIONS: 

LEVEL 2:

Five (5) years’ experience as a TE in programs and contracts of similar scope, type and complexity is required. Bachelor’s degree in Math, Science, Engineering, Statistics, Engineering Management, or related discipline form an accredited college or university is required. Four (4) years of additional TE experience may be substituted for a bachelor’s degree. 

Task Required Skills

• Experience using the Linux CLI
• Experience writing scripts using Bash/Python
• General knowledge of software QA methodologies, tools, and processes
• Experience developing test plans/test suites for UI and visualization software solutions
• Experience automating testing procedures
• Experience writing clear, concise, and comprehensive bug reports and test cases
• Experience with UI Testing tools such as Parasoft Selenic, Katalon, Selenium, mabi, TestIM, Functionize, Perfecto, TestCraft, Squish, and AutonomIQ
• Experience testing APIs using tools such as Postman
• Experience with CI/CD principles, methodologies, and tools such as GitLab CI 

LEVEL 3:

Eight (8) years’ experience as a TE in programs and contracts of similar scope, type and complexity is required. Bachelor’s degree in Math, Science, Engineering, Statistics, Engineering Management, or related discipline form an accredited college or university is required. Four (4) years of additional TE experience may be substituted for a bachelor’s degree.

Task Required Skills

• Experience using the Unix CLI
• Experience developing/maintaining scripts using Bash/Python
• Experience creating test plans and strategies for unit, integration, validation, and performance testing
• Experience with testing and evaluation of software and system level capabilities
• Experience generating test reports to capture the results of software and system level testing
• Experience with automating testing procedures
• Experience with creating and implementing CI/CD strategies
• General ability to read and understand Python
• Experience with Git Source Control System   

DESCRIPTION:

Analyzes system requirements and concept of operations documents, acquisition plans, and system descriptions to develop evaluation and test plans and procedures, prepare for and conduct the data collection and analysis, and report status and results. Supports the development of Government test and evaluation documentation e.g., Test & Evaluation (T&E) Strategy, Test & Evaluation Master Plan, Event Test Plans, Test Readiness Assessments, and T&E Reports. Works with other test organizations to support T&E program integration. Provides specialized T&E capabilities tailored to system functions, level, maturity, and performance area as assigned in the Statement of Work (SOW).

QUALIFICATIONS:

LEVEL 1:

Two (2) years’ experience as a TE in programs and contracts of similar scope, type and complexity is required. Bachelor’s degree in Math, Science, Engineering, Statistics, Engineering Management, or related discipline from an accredited college or university is required. Four (4) years of additional TE experience may be substituted for a bachelor’s degree.

LEVEL 2:

Five (5) years’ experience as a TE in programs and contracts of similar scope, type and complexity is required. Bachelor’s degree in Math, Science, Engineering, Statistics, Engineering Management, or related discipline from an accredited college or university is required. Four (4) years of additional TE experience may be substituted for a bachelor’s degree.

LEVEL 3:

Eight (8) years’ experience as a TE in programs and contracts of similar scope, type and complexity is required. Bachelor’s degree in Math, Science, Engineering, Statistics, Engineering Management or related discipline from an accredited college or university is required. Four (4) years of additional TE experience may be substituted for a bachelor’s degree.