60NANB24D231↗

TITLE: CMU/NIST AI MEASUREMENT SCIENCE & ENGINEERING COOPERATIVE RESEARCH CENTERPURPOSE: ESTABLISH THE CMU/NIST AI MEASUREMENT SCIENCE & ENGINEERING COOPERATIVE RESEARCH CENTER (AIMSEC) TO FACILITATE COLLABORATIVE RESEARCH AND EXPERIMENTATION FOCUSED ON ADVANCING OUR NATIONAL CAPABILITY FOR TEST AND EVALUATION OF MODERN AI CAPABILITIES AND TOOLS. THERE ARE THREE PRINCIPAL GOALS: 1. ADVANCE MODERN AI RISK MANAGEMENT 2. VALIDATE EVALUATION APPROACHES THROUGH STAKEHOLDER PARTNERSHIPS. 3. TRANSLATE ASSESSMENT CAPABILITIES AND METHODOLOGIES TO PRACTICE. RESEARCH WILL FOCUS ON ADVANCING MEASUREMENT SCIENCE FOR MODERN AI SYSTEMS, INCLUDING MACHINE LEARNING (ML) AND GENERATIVE AI (GENAI) SYSTEMS, SUCH AS LARGE LANGUAGE MODELS (LLMS). ACTIVITIES TO BE PERFORMED: CREATE A PRACTICAL TAXONOMY OF THREATS AGAINST LARGE LANGUAGE MODELS (LLMS). THE PROPOSED WORK INCLUDES DEVELOPING TECHNIQUES TO REDUCE MEMORIZATION AND PROTECT CONFIDENTIAL INFORMATION PROVABLY, EVEN IF IT RESULTS IN LESS EXACT OUTPUTS. DEVELOP NEW MEASURES OF ROBUSTNESS FOR ML MODELS THAT BETTER REFLECT A MODEL?S ABILITY TO WITHSTAND ATTACKS IN PRACTICAL SCENARIOS. DEVELOP RICHER DEFINITIONS OF ALIGNMENT, CORRECTNESS, AND INTENT TO DETERMINE THE SUITABILITY OF GENERATIVE AI SYSTEMS FOR THEIR INTENDED USES. CREATE A STATE-OF-THE-ART SUITE OF ATTACKS AGAINST LLMS FOR TESTING NEW MODELS. THESE ACTIVITIES WILL BE ORGANIZED IN THREE STREAMS OF EFFORT ALIGNED WITH NIST AI PRIORITIES. - VALIDITY, RELIABILITY, SAFETY, PRIVACY, AND SECURITY- ACCOUNTABILITY, TRANSPARENCY, FAIRNESS, AND EXPLAINABILITY- GENERATIVE AI EVALUATIONEXPECTED OUTCOMES: DEVELOPMENT OF AI SYSTEM-LEVEL TOOLING, METRICS, EVALUATION PROCEDURES, DEVELOPMENT PROCESSES, AND BEST PRACTICES TO ENSURE AI SYSTEM BUILDERS CONSISTENTLY ENGINEER SAFE AI SYSTEMS. GOALS ARE TO ADVANCE MODERN AI RISK MANAGEMENT, VALIDATE EVALUATION APPROACHES THROUGH STAKEHOLDER PARTNERSHIPS, AND TRANSLATE ASSESSMENT CAPABILITIES AND METHODOLOGIES TO PRACTICE. RESEARCH WILL FOCUS ON ADVANCING MEASUREMENT SCIENCE FOR MODERN AI SYSTEMS, INCLUDING MACHINE LEARNING (ML) AND GENERATIVE AI (GENAI) SYSTEMS, SUCH AS LARGE LANGUAGE MODELS (LLMS). THESE EFFORTS ARE EXPECTED TO YIELD ADDITIONAL APPROACHES TO MITIGATION OF WEAKNESSES AND VULNERABILITIES, PRIVACY PROTECTION, A PRACTICAL TAXONOMY OF THREATS AGAINST LLMS, APPROACHES TO MEET AI GOVERNANCE CHALLENGES, AND NEW SOCIO-TECHNICAL DEFINITIONS AND METRICS.INTENDED BENEFICIARIES: AI STAKEHOLDERS, INCLUDING GOVERNMENT, INDUSTRY, ACADEMIA, AND THE GENERAL PUBLIC, WILL BENEFIT FROM THIS WORK OF ADVANCING CAPABILITY FOR TESTING AND EVALUATING MODERN AI CAPABILITIES AND TOOLS.SUBRECIPIENT ACTIVITIES: THERE ARE NO PLANNED SUBAWARDS.

Project Grant (B) · National Institute of Standards and Technology · to Carnegie-Mellon University (UEI U3NKNFLNQ613) · data as of 2026-09-30

Source: USAspending.gov prime award transactions and FSRS subaward reports, as loaded by SpendQuery (data as of 2026-09-30). Amounts are obligations (money committed), not outlays. The official record on USAspending.gov ↗