Senior Operational Test and Evaluation Analyst

Fort Meade, MD
Defense – Testing /
Regular /
At Agile Defense we know that action defines the outcome and new challenges require new solutions. That’s why we always look to the future and embrace change with an unmovable spirit and the courage to build for what comes next.

Our vision is to bring adaptive innovation to support our nation's most important missions through the seamless integration of advanced technologies, elite minds, and unparalleled agility—leveraging a foundation of speed, flexibility, and ingenuity to strengthen and protect our nation’s vital interests.

Requisition #: 279

Job Title: Operational Test and Evaluation Analyst (Senior/Principal)

Location: 6910 Cooper Avenue Fort Meade, Maryland 20755

Clearance Level: Active DoD - Top Secret/NATO

Required Certification(s): 
·       DoD or Federal T&E School or Course Certification (Certified Test and Evaluation Professional (CTEP), Joint Interface Control Officer (JICO), International Test and Evaluation Association (ITEA) Test and Evaluation Professional, DAWIA, Defense Acquisition University (DAU) Level 1,2 or 3 Certification or commercial industry or academic equivalent).

Joint Interoperability Test Command (JITC) Test, Evaluation and Certification II Services (TEC II) contract provides Information Technology/National Security Systems (IT/NSS) T&E support and services that test and evaluate critical strategic and tactical IT/NSS systems and capabilities that support DoD day-to-day operations. JITC is one of DoD's Operational Test Agency (OTA) who is responsible for testing, evaluating, validating and certification of IT/NSS hardware and software intensive systems, capabilities and products directly supporting DoD's business and warfighting operations.
The candidate should have a good understanding of DoD Information Technology (IT) and how to conduct Operational Test and Evaluation (OT&E) of DoD IT/NSS systems and capabilities. The position requires the selected individual to be able to decompose system mandated and critical requirements and develop test and use cases needed to effectively evaluate the System Under Test (SUT) and provide the needed test result information so that key stakeholders can make the right fielding decisions. The candidate will be responsible for OT&E ensuring that SUT data is planned and collected during events and activities and that that data can be utilized amongst the different test requirement needs. The individual will require above average interpersonal written and verbal skills. Will need to be able to develop a test plan, execute a test, conduct the needed analysis to make Measures of Suitability (MOS), Measures of Effectiveness (MOE) and Measures of Performance (MOP) and Net Ready Key Performance Parameter ((NR KPP) determination of the IT/NSS SUT. Must be able to communicate, collaborate and coordinate in a dynamic and changing environment.

·       In support of integrated DoD IT/NSS OT&E efforts, will conduct SUT requirements decomposition, test planning, execution, analysis and reporting efforts for all test events. Use appropriate system documentation to perform requirements analysis and make sure sufficient information is known about any new capabilities or SUT. Successful planning of integrated Operational Test (OT) events will include the following; must be able to: update and develop a Data Source Matrix (DSM) for each T&E event, develop a formal SUT Risk Assessment (RA), prepare and provide a SUT Test Concept Brief (TCB), create and deliver a SUT Test Plan, create a T&E event Test Readiness Review (TRR) slides, and compile SUT Developmental Evaluation Framework (DEF).
·       Perform T&E execution efforts by assisting in data collection and observe users performing the mission and/or execute operational scenarios; collect, document, and manage all test data In Accordance With (IAW) the JITC OT&E guidance for a Data Management and Analysis Plan (DMAP); leverage instrumentation and automation of data collection and management; hold daily hot washes with the user community to talk about the day’s activities; socialize issues and/or problems encountered; present overall percentages of test objectives completed to date; describe the activities planned for the next day; provide daily Emerging Results Reports (ERRs); and attend actively participate in Data Authentication Group (DAG) events and activities at the end of each SUT test event.
·       Perform Test Reporting by conducting data reduction, analysis, and management in IAW the SUT Test Plan. Provide a Quick Look Report (QLR) that includes initial and emerging test results and lessons learned. Create and deliver a formal SUT Test Report that includes analyzed data and conclusions, including input from all applicable test events, e.g., Interoperability (IOP) and Cybersecurity.
·       Conduct SUT documentation reviews by providing in depth technical reviews/comments as they pertain to SUT programmatic documentation, such as Test and Evaluation Master Plan (TEMP)/Test and Evaluation Strategy (TES), and Requirement Documentation (i.e. Information Support Plan (ISP), DoD Architecture Framework (DoDAF) Technical and Architectural Views, and identify the critical SUT requirements and NR KPP that require needed T&E to ensure DoD customer and stakeholder success.
·       Support an integrated IOP T&E approach in conjunction w/ OT events by completing IOP test planning efforts, executing the test event, collecting, analyzing all data, test reporting, and all other efforts required for a robust, efficient, cost-effective T&E program.

·       Provides input to staff involved in writing and updating technical documentation. Provides guidance and work leadership to less-experienced T&E software, hardware and integrated system engineers and analysts, may serve as a technical team or task leader. Provide consultation on complex projects and be a top-level contributor/specialist; must be expert at problem-solving, identifying risk, and communicating results and recommendations.


Required Certifications
·       DoD or Federal T&E School or Course Certification (Certified Test and Evaluation Professional (CTEP), Joint Interface Control Officer (JICO), International Test and Evaluation Association (ITEA) Test and Evaluation Professional, DAWIA, Defense Acquisition University (DAU) Level 1,2 or 3 Certification or commercial industry or academic equivalent).

Education, Background, and Years of Experience
·       Requires a Technical Master’s Degree in a science, technology or mathematics and 6 years of related DoD system or capability experience (E.g. Tactical Data Link, DoD C2, C4/5ISR, Logistics, Medical Systems, Finance or Homeland Security Systems).


Required Skills
·       Ability to develop/produce OT&E products and documents (E.g. Test Concept Briefs (TCB), Data Source Matrix (DSM), Test Plans, Quick Look Reports (QLR) and Final Report Memorandum) the clearly articulates the OT&E results and findings.
·       Demonstrates expertise in a variety of IT/NSS T&E concepts, practices, and procedures (Tactical Data Link, RF/HF, DoD C2, C4/5ISR, Logistics, Medical Systems, Finance or Homeland Security Systems).
·       Research, design, develop and/or modify DoD enterprise-wide IT/NSS systems and/or application software OT&E activities including planning, collecting data, executing, conducting data analysis and reporting.

Preferred Skills
Have experience in at least two of the following IT/NSS T&E Domains:
·       Development Test and Evaluation (DT&E)
·       Operational Test and Evaluation (OT&E)
·       Interoperability Test and Evaluation (IOP T&E)
·       Cybersecurity Test and Evaluation (CS T&E)
·       Integrated Test and Evaluation (Integrated T&E
·       Standard Conformance and Compliance Test and Evaluation (SCCT&E)
·       NATO/Coalition Parter Verification and Validation T&E
·       Excellent organizational, coordination, interpersonal and team building skills.
·       Experience or familiarity with at least two or more of the following Business Analytics and Intelligence Software capabilities and Automated Software Test and Analysis Tools.
·       Joint Analysis Net-Centric Evaluation Testing Toolkit (JANETT)
·       JITC Data Management Tool (JDMT)
·       DevSecOps
·       JIRA
·       Confluence
·       ServiceNow
·       LoadRunner
·       Elastic
·       Power BI
·       Tableau
·       Should have some experience or familiarity with at least one of the following DoD IT/NSS processes and or methodologies.
·       DoD Acquisition Processes and Regulations
·       DoD Architecture Framework (DoDAF)
·       Net Ready Key Performance Parameters (NR KPP)
·       DOT&E Guidebook and Instructions on conducting OT&E activities.
·       Science Base Test Design (SBTD)
·       Design of Experiment (DOE)
·       DoD/Military Service OTA Specific Guidebook and Instructions on conducting OT&E activities.


Environmental Conditions
·       Government site with 0%-10% travel possible. Possible off-hours work to support releases and outages. General office environment. Work is generally sedentary in nature, but may require standing and walking for up to 10% of the time. The working environment is generally favorable. Lighting and temperature are adequate, and there are not hazardous or unpleasant conditions caused by noise, dust, etc. Work is generally performed within an office environment, with standard office equipment available.

Strength Demands
·       Sedentary – 10 lbs. Maximum lifting, occasional lift/carry of small articles.  Some occasional walking or standing may be required.   Jobs are sedentary if walking and standing are required only occasionally, and all other sedentary criteria are met.

Physical Requirements
·       Stand or Sit; Walk; Repetitive Motion; Use Hands / Fingers to Handle or Feel; Stoop, Kneel, Crouch, or Crawl; See; Push or Pull; Climb (stairs, ladders) or Balance (ascend / descend, work atop, traverse).
Employees of Agile Defense are our number one priority, and the importance we place on our culture here is fundamental. Our culture is alive and evolving, but it always stays true to its roots. Here, you are valued as a family member, and we believe that we can accomplish great things together. Agile Defense has been highly successful in the past few years due to our employees and the culture we create together. What makes us Agile? We call it the 6Hs, the values that define our culture and guide everything we do. Together, these values infuse vibrancy, integrity, and a tireless work ethic into advancing the most important national security and critical civilian missions. It's how we show up every day. It's who we are.

Happy - Be Infectious.
Happiness multiplies and creates a positive and connected environment where motivation and satisfaction have an outsized effect on everything we do.

Helpful - Be Supportive.
Being helpful is the foundation of teamwork, resulting in a supportive atmosphere where collaboration flourishes, and collective success is celebrated.

Honest - Be Trustworthy.
Honesty serves as our compass, ensuring transparent communication and ethical conduct, essential to who we are and the complex domains we support.

Humble - Be Grounded.
Success is not achieved alone, humility ensures a culture of mutual respect, encouraging open communication, and a willingness to learn from one another and take on any task.

Hungry - Be Eager.
Our hunger for excellence drives an insatiable appetite for innovation and continuous improvement, propelling us forward in the face of new and unprecedented challenges.

Hustle - Be Driven.
Hustle is reflected in our relentless work ethic, where we are each committed to going above and beyond to advance the mission and achieve success.

Equal Opportunity Employer/Protected Veterans/Individuals with Disabilities
The contractor will not discharge or in any other manner discriminate against employees or applicants because they have inquired about, discussed, or disclosed their own pay or the pay of another employee or applicant. However, employees who have access to the compensation information of other employees or applicants as a part of their essential job functions cannot disclose the pay of other employees or applicants to individuals who do not otherwise have access to compensation information, unless the disclosure is (a) in response to a formal complaint or charge, (b) in furtherance of an investigation, proceeding, hearing, or action, including an investigation conducted by the employer, or (c) consistent with the contractor’s legal duty to furnish information. 41 CFR 60-1.35(c)