cxcscmu/SkillLearnBench - Page 17

greedy-point-matching

Match clustered centroids to expert annotations using greedy nearest-neighbor matching with distance constraints. Compute F1 scores and delta metrics for clustering quality assessment.

Langue du texte source : anglais

mars-cloud-data-loading-matching

Load citizen science and expert annotation datasets, match them by image using file_rad column, handle missing data, and prepare data for clustering evaluation.

Langue du texte source : anglais

output-formatting-pareto-results

Format and write Pareto frontier results to CSV file with proper rounding and column ordering.

Langue du texte source : anglais

pareto-frontier-optimization

Execute grid search over DBSCAN hyperparameters, evaluate each combination across all images, filter by F1 threshold, and identify Pareto-optimal solutions balancing F1 score and delta metric.

Langue du texte source : anglais

deduplicate-and-order-vulnerability-records

Ensure vulnerability records are deduplicated and ordered according to ground-truth requirements.

Langue du texte source : anglais

extract-cvss-score-with-correct-priority

Extract CVSS score from vulnerability data using the correct priority order (NVD → GHSA → RedHat) and handle nested JSON structure properly. Use case-insensitive field access and correct JSON path navigation.

Langue du texte source : anglais

filter-vulnerabilities-by-severity-level

Filter vulnerability records to include only HIGH and CRITICAL severity levels with case-sensitive exact matching.

Langue du texte source : anglais

format-and-write-csv-with-proper-escaping

Write CSV output with correct field quoting and escaping for special characters, using standard CSV formatting.

Langue du texte source : anglais

handle-null-and-missing-values-in-vulnerability-data

Properly handle null, missing, and empty values in vulnerability records with appropriate fallback values.

Langue du texte source : anglais

map-trivy-json-fields-to-csv-columns-accurately

Correctly identify and extract Trivy vulnerability JSON field names and map them to the required CSV output columns in exact order.

Langue du texte source : anglais

calculate-distance-to-nearest-pacific-boundary

Combine all Pacific plate boundary geometries using `.unary_union` and calculate the distance from each earthquake to this combined boundary geometry. Returns the minimum distance in kilometers for each earthquake.

Langue du texte source : anglais

execute-complete-geospatial-analysis-pipeline

Orchestrate the full analysis workflow: load data, identify Pacific plate, filter earthquakes and boundaries, project to EPSG:4087, calculate distances, find the furthest earthquake, and save results. Use this as the main execution skill.

Langue du texte source : anglais

filter-earthquakes-within-pacific-plate

Use the `.within()` geometric method to identify earthquakes that are contained inside the Pacific plate polygon. Use this skill to ensure only earthquakes actually inside the Pacific plate are analyzed.

Langue du texte source : anglais

filter-pacific-plate-boundaries

Filter the boundary dataset to include only boundaries relevant to the Pacific plate (where PlateA or PlateB equals the Pacific plate identifier). Use this skill to exclude irrelevant boundaries before distance calculations.

Langue du texte source : anglais

find-earthquake-furthest-from-pacific-boundary

Identify the earthquake with the maximum distance to the Pacific plate boundary from the earthquakes within the Pacific plate. Use this skill to locate the target earthquake for final output.

Langue du texte source : anglais

identify-pacific-plate-identifier

Examine the plates dataset to find the exact identifier used for the Pacific plate (e.g., "PA", "Pacific", etc.). Use this skill early in the analysis to ensure consistent filtering across boundaries and plates.

Langue du texte source : anglais

load-and-parse-plate-boundary-data

Load plate boundary GeoJSON and create a GeoDataFrame with proper geometry parsing. Verify column names (PlateA, PlateB) match the dataset structure. Use this skill to prepare boundary data before filtering for Pacific plate relevance.

Langue du texte source : anglais

load-and-parse-plate-polygon-data

Load plate polygon GeoJSON and parse geometries correctly. Verify the column name used for plate identifiers (e.g., 'PlateName' or similar). Use this skill to prepare plate polygon data for containment checks.

Langue du texte source : anglais

load-and-validate-earthquake-data

Load earthquake data from GeoJSON format and validate that it contains required fields (id, time, magnitude, latitude, longitude, place). Use this skill when initializing the analysis to ensure data integrity before processing.

Langue du texte source : anglais

output-result-to-json-file

Write the final result dictionary to a JSON file at `/root/answer.json` with proper formatting and field validation. Use this skill as the final step to save the analysis result.

Langue du texte source : anglais

project-data-to-epsg-4087-for-distance-calculation

Reproject earthquake points and boundary geometries to EPSG:4087 (World Equidistant Cylindrical) before calculating distances. Use this skill to ensure accurate distance measurements in kilometers.

Langue du texte source : anglais

evidence-validation-checkpoint

Before writing final answers, validate that all required evidence has been extracted, multi-hop traversal was executed, and answers are complete against expected values.

Langue du texte source : anglais

multi-hop-evidence-extraction

Extract evidence from all three tiers (explicit reviewers, substantive feedback contributors from Slack and transcripts, and other identifiable contributors). Follow artifact references and traverse relationships to collect complete answer sets.

Langue du texte source : anglais

product-grounded-artifact-retrieval

Load enterprise data from /root/DATA, identify the correct artifact version for each product mentioned in questions, and reject cross-product distractors. Apply strict 2-signal product grounding (artifact metadata + question context).

Langue du texte source : anglais

question-parsing

Load and parse questions from /root/question.txt, extract question IDs and their artifact/product context. Validate that all questions are correctly mapped before proceeding to data retrieval.

Langue du texte source : anglais

token-counting-and-output

Count tokens consumed during data retrieval operations, validate numeric format, and write results to /root/answer.json with proper structure.

Langue du texte source : anglais

aggregate-holdings-across-multiple-funds

Search multiple funds' holdings data for a specific security (by CUSIP) and aggregate the total share values held by each fund manager. Use this to rank fund managers by their investment in a particular security.

Langue du texte source : anglais

calculate-aum-from-holdings

Sum the market values of all holdings to derive the Assets Under Management (AUM) for a fund as of a specific report date. Use this to answer questions about fund size in a given quarter.

Langue du texte source : anglais

compare-holdings-between-quarters

Load holdings for the same fund in two different quarters, match positions by security identifier, and calculate the change in shares and market values. Use this to identify which securities received increased investment between reporting periods.

Langue du texte source : anglais

examine-raw-holdings-data-structure

Inspect the actual holdings dataset to understand its schema, field names, and data patterns before applying filters. Use this to identify the correct field name that distinguishes equity securities from bonds, options, warrants, and other non-stock…

Langue du texte source : anglais

filter-holdings-by-security-type-stocks-only

Remove non-equity securities (bonds, options, warrants, preferred shares, funds) from holdings data, keeping only common stock positions. Use the correct security type field identified from the raw data structure inspection.

Langue du texte source : anglais

fuzzy-search-coverpage-for-fund-identification

Search the COVERPAGE dataset using fuzzy matching to locate a specific fund by name and extract its accession_number for subsequent analysis. Use this when you need to identify a fund's filing by partial or approximate name matching.

Langue du texte source : anglais

load-holdings-data-by-accession-number

Retrieve and load the complete holdings dataset for a specific fund using its accession_number. Use this to access position-level details needed for AUM, stock count, and comparative analysis.

Langue du texte source : anglais

search-cusip-for-security

Find the CUSIP identifier for a specific security (e.g., Palantir) by searching across all holdings data or a security master file. Use this when you need to locate a specific stock across multiple fund positions.

Langue du texte source : anglais

validate-accession-number-and-report-date

Confirm that the accession_number retrieved corresponds to the correct quarter and report date before using it for analysis. Use this to prevent analyzing data from the wrong quarter.

Langue du texte source : anglais

create-and-apply-git-patch-files-for-druid-security-fixes

Generate proper git-compatible patch files that address the empty key validation and JavaScript filter disabling vulnerabilities, then apply them to the Druid 0.20.0 source repository.

Langue du texte source : anglais

disable-javascript-execution-in-druid-filters

Configure and enforce a security policy that completely disables JavaScript filter evaluation in Apache Druid, preventing arbitrary code execution through the javascript filter type even if structural validation is bypassed.

Langue du texte source : anglais

input-stream-validation-before-jackson-deserialization

Validate and sanitize raw JSON input at the point where it enters Jackson's deserialization pipeline, before any ObjectMapper.readValue() call processes it, to prevent bypass attacks using empty keys.

Langue du texte source : anglais

locate-jackson-deserialization-entry-points-in-druid

Find the exact code locations where user-supplied JSON is deserialized into DimFilter and other security-sensitive objects in Apache Druid's indexing pipeline, to identify where raw input validation must occur before Jackson processes it.

Langue du texte source : anglais

calculate-average-pr-merge-time

Compute the average number of days from PR creation to merge for all merged PRs in December 2024, using correct timestamp parsing and filtering.

Langue du texte source : anglais