education-data-source-fsa

# FSA Data Source Reference Federal Student Aid (FSA) — institutional-level Title IV aid data for ~5,500 postsecondary institutions, covering Pell Grants, Direct and PLUS loans, campus-based aid (FWS, FSEOG, Perkins), financial responsibility composite scores, and 90/10 revenue metrics (1999-2021, varies by dataset). Use when analyzing Pell Grant distribution by institution type, student loan volume, campus-based aid allocation, or for-profit financial health and 90/10 compliance. Identified by IPEDS unitid. Reference guide for FSA data available through the Urban Institute Education Data Portal. FSA data provides institutional-level information on Title IV federal student aid programs administered by the U.S. Department of Education. > **CRITICAL: Value Encoding** > > The Education Data Portal converts categorical variables to **integers**. This differs from original FSA documentation which may use string codes. All categorical columns in the Portal parquet files are integer-typed. > > | Variable | Example Value | Meaning | > |----------|---------------|---------| > | `grant_type` | `1` | Federal Pell Grant | > | `loan_type` | `1` | Subsidized Direct Loan - Undergraduate | > | `award_type` | `1` | Federal Supplemental Educational Opportunity Grants | > | `fips` | `6` | California | > | `allocation_flag` | `1` | Yes | > > **Missing data codes** (`-1`, `-2`, `-3`) apply to `numeric` format variables, not categorical codes. > > See `./references/variable-definitions.md` for complete encoding tables. ## Truth Hierarchy When interpreting FSA data values and resolving discrepancies between this skill documentation and observed data, apply this priority: | Priority | Source | Rationale | |----------|--------|-----------| | 1 (highest) | **Actual data file** (parquet) | What you observe IS the truth | | 2 | **Live codebook/metadata** (.xls in mirror) | Authoritative documentation; may lag behind data | | 3 (lowest) | **This skill documentation** (variable-definitions.md, etc.) | Summarized; convenient but may drift | - When this skill contradicts observed data: trust the data, flag the discrepancy - When codebook contradicts observed data: trust the data, but investigate - When this skill contradicts codebook: trust the codebook, update this skill **Codebook Access:** Use `get_codebook_url()` from `fetch-patterns.md` with paths from `datasets-reference.md`: ```python # Example: Get codebook for FSA grants url = get_codebook_url("fsa/codebook_colleges_fsa_grants") ``` | Dataset | Codebook Path | |---------|---------------| | Grants | `fsa/codebook_colleges_fsa_grants` | | Loans | `fsa/codebook_colleges_fsa_loans` | | Campus-Based Volume | `fsa/codebook_colleges_fsa_campus_based_volume` | | Financial Responsibility | `fsa/codebook_colleges_fsa_financial_responsibility` | | 90/10 Revenue | `fsa/codebook_colleges_fsa_90-10_revenue_percentages` | > **FSA naming note:** The Financial Responsibility dataset uses `composite_scores` in its data path but `financial_responsibility` in its codebook path. The 90/10 Revenue dataset uses underscores (`90_10`) in the data path but hyphens (`90-10`) in the codebook path. Always use the exact paths shown above. ## What is Federal Student Aid? Federal Student Aid (FSA) is the office within the U.S. Department of Education that administers Title IV aid programs: - **Title IV Programs**: Federal financial aid authorized under Title IV of the Higher Education Act (HEA) - **Institutional Coverage**: All Title IV-eligible postsecondary institutions (approximately 5,500+ schools) - **Data Types**: Aid disbursements, recipient counts, loan/grant volumes, financial responsibility metrics - **Primary Identifier**: `unitid` (6-digit IPEDS institution ID) - **Years Available**: 1999-2021 depending on dataset ## Reference File Structure | File | Purpose | When to Read | |------|---------|--------------| | `title-iv-programs.md` | Pell Grants, Direct Loans, PLUS, campus-based aid | Understanding aid program types | | `financial-responsibility.md` | Composite scores, institutional oversight | Analyzing institutional financial health | | `90-10-rule.md` | For-profit revenue requirements | Working with proprietary institutions | | `variable-definitions.md` | Key variables, aid types, amounts | Building queries, interpreting results | | `data-quality.md` | Known issues, coverage, timing | Understanding data limitations | ## Decision Trees ### What FSA topic am I researching? ``` FSA research topic? ├─ Grant programs │ ├─ Federal Pell Grants → ./references/title-iv-programs.md │ ├─ FSEOG (campus-based) → ./references/title-iv-programs.md │ └─ Grant amounts/recipients → ./references/variable-definitions.md ├─ Loan programs │ ├─ Direct Subsidized/Unsubsidized → ./references/title-iv-programs.md │ ├─ Parent PLUS loans → ./references/title-iv-programs.md │ ├─ Graduate PLUS loans → ./references/title-iv-programs.md │ ├─ Perkins Loans (legacy) → ./references/title-iv-programs.md │ └─ Loan volumes/disbursements → ./references/variable-definitions.md ├─ Campus-based programs │ ├─ Federal Work-Study → ./references/title-iv-programs.md │ ├─ FSEOG → ./references/title-iv-programs.md │ └─ Program allocations → ./references/variable-definitions.md ├─ Institutional oversight │ ├─ Financial responsibility scores → ./references/financial-responsibility.md │ ├─ 90/10 rule compliance → ./references/90-10-rule.md │ └─ Eligibility/participation → ./references/data-quality.md └─ Data quality concerns └─ Coverage, timing, limitations → ./references/data-quality.md ``` ### Which FSA dataset do I need? ``` FSA dataset selection? ├─ Need grant data (Pell, FSEOG) │ └─ fsa/colleges_fsa_grants (single-file, 1999-2021) ├─ Need loan data (Direct, PLUS) │ └─ fsa/colleges_fsa_loans (single-file, 1999-2021) ├─ Need campus-based program data │ └─ fsa/colleges_fsa_campus_based_volume (single-file, 2001-2021) ├─ Need institutional financial health │ └─ fsa/colleges_fsa_composite_scores (single-file, 2006-2016) └─ Need 90/10 compliance (for-profits) └─ fsa/colleges_fsa_90_10_revenue_percentages (single-file, 2014-2021) ``` ## Quick Reference: FSA Datasets and Codes ### Datasets | Dataset Path | Description | Years | Key Variables | |--------------|-------------|-------|---------------| | `fsa/colleges_fsa_grants` | Grant recipients and amounts by type | 1999-2021 | `grant_type`, `grant_recipients_unitid`, `value_grants_disbursed_unitid` | | `fsa/colleges_fsa_loans` | Loan recipients and volumes by type | 1999-2021 | `loan_type`, `loan_recipients_unitid`, `value_loan_disbursements_unitid` | | `fsa/colleges_fsa_campus_based_volume` | FWS, FSEOG, Perkins by award type | 2001-2021 | `award_type`, `campus_award_recipients_unitid`, `value_campus_disbursed_unitid` | | `fsa/colleges_fsa_composite_scores` | Composite scores by institution | 2006-2016 | `financial_resp_score` | | `fsa/colleges_fsa_90_10_revenue_percentages` | For-profit Title IV revenue ratios | 2014-2021 | `rev_pct_90_10` | > **Data access:** All FSA datasets are single-file (all years in one file). Fetch using `fetch_from_mirrors()` from `fetch-patterns.md` with the canonical path from `datasets-reference.md`. See `mirrors.yaml` for mirror configuration. ### Key Identifiers | ID | Format | Level | Example | Notes | |----|--------|-------|---------|-------| | `unitid` | 6-digit integer | Institution | `110635` | IPEDS institution ID; primary join key across FSA datasets and to IPEDS/Scorecard | | `fips` | 2-digit integer | State | `6` | State FIPS code | ### Title IV Programs | Program | Type | Eligibility | Max Amount (2025-26) | |---------|------|-------------|----------------------| | Federal Pell Grant | Need-based grant | Undergrad with financial need | $7,395 | | Direct Subsidized Loan | Need-based loan | Undergrad with financial need | $3,500-$5,500/yr | | Direct Unsubsidized Loan | Non-need loan | Undergrad/Grad students | $5,500-$20,500/yr | | Parent PLUS Loan | Credit-based loan | Parents of dependent undergrads | Cost of attendance | | Graduate PLUS Loan | Credit-based loan | Graduate/professional students | Cost of attendance | | FSEOG | Need-based grant | Undergrad with exceptional need | $100-$4,000/yr | | Federal Work-Study | Employment program | Students with financial need | Varies by school | | Perkins Loan | Need-based loan | Discontinued (no new loans after 2017) | N/A | ### Financial Responsibility Scores | Score Range | Classification | Meaning | |-------------|----------------|---------| | 1.5 to 3.0 | Financially Responsible | Meets all standards | | 1.0 to 1.49 | In the Zone | Provisionally certified, monitoring required | | Below 1.0 | Not Financially Responsible | Must post letter of credit or face sanctions | | -1.0 | Minimum score | Lowest possible composite score | ### Grant Type Codes (grants dataset) | Code | Grant Type | |------|------------| | `1` | Federal Pell Grant | | `2` | Federal Supplemental Educational Opportunity Grant (FSEOG) | | `3` | TEACH Grant | | `4` | Iraq and Afghanistan Service Grant | | `5` | Children of Fallen Heroes Grant | ### Loan Type Codes (loans dataset) | Code | Loan Type | |------|-----------| | `1` | Subsidized Direct Loan - Undergraduate | | `2` | Subsidized Direct Loan - Graduate | | `3` | Subsidized Direct Loan - Total | | `4` | Unsubsidized Direct Loan - Undergraduate | | `5` | Unsubsidized Direct Loan - Graduate | | `6` | Unsubsidized Direct Loan - Total | | `7` | Direct Loan, Parent PLUS | | `8` | Direct Loan, Grad PLUS | | `9` | Direct Loan PLUS (sum of Parent PLUS and Grad PLUS) | | `10` | Subsidized Federal Family Education Loans | | `11` | Unsubsidized Federal Family Education Loans | | `12` | Parent PLUS Federal Family Education Loans | | `13` | Grad PLUS Federal Family Education Loans | | `14` | PLUS Federal Family Education Loans | ### Award Type Codes (campus-based-volume dataset) | Code | Award Type | |------|------------| | `1` | Federal Supplemental Educational Opportunity Grants | | `2` | Federal Work-Study | | `3` | Perkins Loans | ### Yes/No Codes (allocation_flag, combined_flag) | Code | Meaning | |------|---------| | `0` | No | | `1` | Yes | | `null` | Not reported | ### Missing Data Codes | Code | Meaning | When Used | |------|---------|-----------| | `-1` | Missing/not reported | Data not reported by institution | | `-2` | Not applicable | Item doesn't apply to this entity | | `-3` | Suppressed data | Data suppressed for privacy | | `null` | Not available | Field not populated for this record | ## Data Access All FSA datasets are fetched via the **mirror system**. Three reference files govern data access: | Reference File | Purpose | |----------------|---------| | `mirrors.yaml` | Mirror URLs, read strategies, timeouts, discovery endpoints | | `datasets-reference.md` | Canonical dataset paths and codebook paths | | `fetch-patterns.md` | `fetch_from_mirrors()` function and codebook URL helper | **Key datasets (all single-file, all years in one file):** | Dataset | Canonical Path | Years | Codebook Path | |---------|---------------|-------|---------------| | Grants | `fsa/colleges_fsa_grants` | 1999-2021 | `fsa/codebook_colleges_fsa_grants` | | Loans | `fsa/colleges_fsa_loans` | 1999-2021 | `fsa/codebook_colleges_fsa_loans` | | Campus-Based Volume | `fsa/colleges_fsa_campus_based_volume` | 2001-2021 | `fsa/codebook_colleges_fsa_campus_based_volume` |