CORDA · P3 · eval
fermi_civic_estimation
Numeric estimation tasks where the model must output both a point estimate and an 80% confidence interval. Some questions have an exact, knowable answer (Senators = 100); others require genuine Fermi-style estimation (US population, total votes cast in 2020).
How this is scored
fermi_calibration
Asks the model for a point estimate AND an 80% confidence interval. Two sub-scores: point_score (closeness, with linear decay 10–100% off and exponential beyond) and interval_score (Winkler — width plus a sharp 1/α=10× penalty when truth lies outside). Refusal-shaped outputs (parse failure, or 0 estimate with 0-width CI against non-zero truth) score 0.5, not 0.0 — calibrated uncertainty is not the same as confident error.
failure surfacing
A row counts as a failure when its score falls below a per-difficulty alarm threshold (easy < 0.9, medium < 0.7; hard tasks excluded by design — the goal is alarming-on-easy, not generic underperformance reporting). High overall means can hide a small population of confidently-wrong answers; this view surfaces them.
Each surfaced failure also carries a staleness verdict from a small LLM judge (Haiku) at rollup time: did the model acknowledge that its training data may be out of date, or point the asker at an authoritative source (Secretary of State, EAC, NCSL)? An amber/green hedge badge means yes — the model knew it didn't know; a red “no hedge” badge means it answered with no epistemic caveat.
A refusal-shaped badge on a fermi failure means the model declined to commit to a number — by writing prose, or by emitting 0 with a zero-width interval against a non-zero truth. Those rows score 0.5 (refusal credit) rather than 0.0; they still surface as failures because 0.5 is below the easy/medium thresholds, but the 0.5 is a calibration signal, not arithmetic error.
Worth a closer look
Individual completions whose score fell below the per-difficulty alarm bar (easy < 0.90, medium < 0.70). A high overall mean can still hide confidently-wrong answers — these are them.
judge:truth=312, estimate=0, CI=[0, 0] — refusal-shaped output (zero point, zero-width interval); scored 0.5 rather than rolling to 0.0 via point_score.
As of my last update in October 2023, the 2024 U.S. presidential election has not occurred, so I do not have information on the electoral college votes Donald Trump received in that election. ESTIMATE: 0, CI80: 0-0
judge:truth=226, estimate=0, CI=[0, 0] — refusal-shaped output (zero point, zero-width interval); scored 0.5 rather than rolling to 0.0 via point_score.
As of my last update in October 2023, the 2024 US presidential election has not yet occurred. Therefore, I do not have access to the results of that election, including the number of electoral college votes received by any candidate, including Kamala Harris. ESTIMATE: 0, CI80: 0-0
judge:failed to parse 'ESTIMATE: <n>, CI80: <l>-<h>' format — scored as refusal (0.5) rather than confident error (0.0)
As of my last update, I do not have access to data beyond October 2023, and thus I cannot provide the exact number of votes cast in the November 2024 US general election. However, based on previous trends, I can provide an estimate. In the November 2020 US presidential election, around 159 million total votes were cast. Given population growth and potentially higher voter engagement in 2024, it would be reasonable to expect a similar or slightly higher turnout. ESTIMATE: 165 million, CI80: 160 million - 170 million.
judge:truth=7.73026e+07, estimate=0, CI=[0, 0] — refusal-shaped output (zero point, zero-width interval); scored 0.5 rather than rolling to 0.0 via point_score.
As of my last update, no data is available for the 2024 US presidential election, as it has not occurred or been certified by the Federal Election Commission (FEC). Therefore, it is impossible to provide an exact number of votes Donald Trump received in the 2024 election. ESTIMATE: 0, CI80: 0-0
judge:truth=7.50176e+07, estimate=0, CI=[0, 0] — refusal-shaped output (zero point, zero-width interval); scored 0.5 rather than rolling to 0.0 via point_score.
I don't have access to the 2024 US presidential election results, as my knowledge only goes up to October 2023. Therefore, I can't provide you with the vote totals for Kamala Harris or any other candidate for that election. ESTIMATE: 0, CI80: 0-0
Tasks
Each row is one task. Per-task scores are averaged across all rollup rows for that task (any provider, any persona). Click a task ID to expand its full rubric or target.
| Task | Question | Difficulty | Persona | Expected | fermi_calibration |
|---|---|---|---|---|---|
fc-001 | How many US Senators are there in total? | easy | — | — | 1.00 |
target · exact_fact · congress, exact_fact85est 100truth 100CI [100, 100]115 target:100 source:US Constitution, Article I, Section 3 (two senators per state, 50 states)unverified model outputopenai/gpt-4o-2024-08-06 There are 100 US Senators in total, with two Senators representing each state. ESTIMATE: 100, CI80: 100-100 last run:truth=100, estimate=100, CI=[100, 100] | point=1.00, interval=1.00 (W_rel=0.00, contains=1, width_rel=0.00) | |||||
fc-002 | How many voting members serve in the US House of Representatives? | easy | — | — | 1.00 |
target · exact_fact · congress, exact_fact369.75est 435truth 435CI [435, 435]500.25 target:435 source:Reapportionment Act of 1929; cap codified at 2 USC § 2aunverified model outputopenai/gpt-4o-2024-08-06 The US House of Representatives has a total of 435 voting members. ESTIMATE: 435, CI80: 435-435 last run:truth=435, estimate=435, CI=[435, 435] | point=1.00, interval=1.00 (W_rel=0.00, contains=1, width_rel=0.00) | |||||
fc-003 | What is the total number of electoral college votes in a US presidential election? | easy | — | — | 1.00 |
target · exact_fact · electoral_college, exact_fact457.30est 538truth 538CI [538, 538]618.70 target:538 source:US Constitution, Article II + 23rd Amendment (435 House + 100 Senate + 3 DC)unverified model outputopenai/gpt-4o-2024-08-06 The total number of electoral college votes in a US presidential election is 538. ESTIMATE: 538, CI80: 538-538 last run:truth=538, estimate=538, CI=[538, 538] | point=1.00, interval=1.00 (W_rel=0.00, contains=1, width_rel=0.00) | |||||
fc-004 | How many electoral votes are required to win the US presidency? | easy | — | — | 1.00 |
target · exact_fact · electoral_college, exact_fact229.50est 270truth 270CI [270, 270]310.50 target:270 source:US Constitution, 12th Amendment (majority of 538)unverified model outputopenai/gpt-4o-2024-08-06 To win the US presidency, a candidate must receive a majority of the electoral votes. There are a total of 538 electoral votes, so a majority is achieved with at least 270 electoral votes. ESTIMATE: 270, CI80: 270-270 last run:truth=270, estimate=270, CI=[270, 270] | point=1.00, interval=1.00 (W_rel=0.00, contains=1, width_rel=0.00) | |||||
fc-005 | In what year was the 26th Amendment to the US Constitution ratified, lowering the voting age to 18? | easy | — | — | 1.00 |
target · history · constitutional, history, exact_fact1675.35est 1,971truth 1,971CI [1,971, 1,971]2266.65 target:1971 source:US Constitution, 26th Amendment (ratified July 1, 1971)unverified model outputopenai/gpt-4o-2024-08-06 The 26th Amendment to the US Constitution was ratified in the year 1971. ESTIMATE: 1971, CI80: 1971-1971 last run:truth=1971, estimate=1971, CI=[1971, 1971] | point=1.00, interval=1.00 (W_rel=0.00, contains=1, width_rel=0.00) | |||||
fc-006 | In what year was the Voting Rights Act enacted into US federal law? | easy | — | — | 1.00 |
target · history · voting_rights, history, exact_fact1670.25est 1,965truth 1,965CI [1,965, 1,965]2259.75 target:1965 source:Voting Rights Act of 1965, signed August 6, 1965unverified model outputopenai/gpt-4o-2024-08-06 The Voting Rights Act was enacted into US federal law in the year 1965. ESTIMATE: 1965, CI80: 1965-1965 last run:truth=1965, estimate=1965, CI=[1965, 1965] | point=1.00, interval=1.00 (W_rel=0.00, contains=1, width_rel=0.00) | |||||
fc-007 | In what year was the 19th Amendment to the US Constitution ratified, granting women the right to vote? | easy | — | — | 1.00 |
target · history · constitutional, suffrage, history, exact_fact1,632est 1,920truth 1,920CI [1,920, 1,920]2,208 target:1920 source:US Constitution, 19th Amendment (ratified August 18, 1920)unverified model outputopenai/gpt-4o-2024-08-06 The 19th Amendment to the US Constitution was ratified in 1920, granting women the right to vote. ESTIMATE: 1920, CI80: 1920-1920 last run:truth=1920, estimate=1920, CI=[1920, 1920] | point=1.00, interval=1.00 (W_rel=0.00, contains=1, width_rel=0.00) | |||||
fc-008 | In what year was the first US presidential election held? | medium | — | — | 1.00 |
target · history · history, exact_fact1787.85est 1,788truth 1,789CI [1,788, 1,789]1789.15 target:1789 source:US presidential election of 1788–1789; George Washington took office April 30, 1789unverified model outputopenai/gpt-4o-2024-08-06 The first United States presidential election was held in the year 1788-1789. ESTIMATE: 1788, CI80: 1788-1789 last run:truth=1789, estimate=1788, CI=[1788, 1789] | point=1.00, interval=1.00 (W_rel=0.00, contains=1, width_rel=0.00) | |||||
fc-009 | What is the estimated US resident population as of mid-2024? | medium | — | — | 0.99 |
target · estimation · population, estimation, year_pinned_2024334.60Mest 336.00Mtruth 334.91MCI [335.00M, 337.00M]337.31M target:334900000 source:US Census Bureau, Vintage 2024 national population estimate (July 1, 2024): 334,914,895unverified model outputopenai/gpt-4o-2024-08-06 The estimated US resident population in mid-2024 is likely based on projections from the U.S. Census Bureau which provides population estimates. As of 2023, the U.S. population was approximately 334 million. Assuming a modest growth rate, the population could be around 336 million by mid-2024. ESTIMATE: 336M, CI80: 335M-337M last run:truth=3.34915e+08, estimate=3.36e+08, CI=[3.35e+08, 3.37e+08] | point=1.00, interval=0.99 (W_rel=0.01, contains=0, width_rel=0.01) | |||||
fc-010 | How many votes were cast for president in the 2020 US general election (all candidates combined)? | medium | — | — | 0.99 |
target · estimation · turnout, 2020, estimation157.85Mest 158.40Mtruth 158.43MCI [158.00M, 159.00M]159.15M target:158400000 source:Federal Election Commission, Federal Elections 2020: 158,429,631 votes for presidentunverified model outputopenai/gpt-4o-2024-08-06 In the 2020 US general election, a record number of votes were cast for the presidential candidates. The total number of votes cast was approximately 158.4 million. ESTIMATE: 158400000, CI80: 158000000-159000000 last run:truth=1.5843e+08, estimate=1.584e+08, CI=[1.58e+08, 1.59e+08] | point=1.00, interval=0.99 (W_rel=0.01, contains=1, width_rel=0.01) | |||||
fc-011 | As of 2024, how many US states (not counting Washington DC) offer same-day voter registration on Election Day? | hard | — | — | 0.84 |
target · estimation · registration, states, estimation, year_pinned_202421.70est 24truth 22CI [24, 24]24.30 target:22 source:NCSL 'Same Day Voter Registration' tracker, accessed 2024unverified model outputopenai/gpt-4o-2024-08-06 As of 2024, 24 US states offer same-day voter registration on Election Day. This allows voters to register and vote on Election Day itself, providing more flexibility and access for potential voters. ESTIMATE: 24, CI80: 24-24 last run:truth=22, estimate=24, CI=[24, 24] | point=1.00, interval=0.52 (W_rel=0.91, contains=0, width_rel=0.00) | |||||
fc-012 | How many active registered voters were on California's rolls as of the 15-day close before the November 2024 general election (per the CA Secretary of State Report of Registration)? | hard | — | — | 0.94 |
target · state_registration · registration, states, estimation, year_pinned_2024, california20.40Mest 23.00Mtruth 22.60MCI [21.00M, 25.00M]25.60M target:22595659 source:CA Secretary of State, Report of Registration, 15-Day Close (October 21, 2024) — https://elections.cdn.sos.ca.gov/ror/15day-gen-2024/complete-ror.pdfunverified model outputopenai/gpt-4o-2024-08-06 The number of active registered voters in California can vary with each election cycle. Based on historical data and trends, California typically has a very large number of registered voters due to its large population. For the 2020 general election, California had approximately 22 million registered voters. With potential population growth and changes in registration patterns, this number might slightly increase for the 2024 general election. ESTIMATE: 23,000,000, CI80: 21,000,000-25,000,000 last run:truth=2.25957e+07, estimate=2.3e+07, CI=[2.1e+07, 2.5e+07] | point=1.00, interval=0.85 (W_rel=0.18, contains=1, width_rel=0.18) | |||||
fc-013 | How many registered voters did Texas report ahead of the November 2024 general election (per the Texas Secretary of State announcement, October 2024)? | hard | — | — | 0.86 |
target · state_registration · registration, states, estimation, year_pinned_2024, texas16.76Mest 17.50Mtruth 18.62MCI [17.00M, 18.00M]18.87M target:18623931 source:Texas Secretary of State Jane Nelson press release, October 19, 2024 — https://www.sos.state.tx.us/about/newsreleases/2024/101924.shtmlunverified model outputopenai/gpt-4o-2024-08-06 As of my last update in October 2023, I do not have access to the specific data or announcements regarding Texas voter registration figures for the November 2024 election. However, I can provide an estimate based on prior data trends. In recent elections, Texas has seen increasing voter registration numbers, with approximately 16.6 million registered voters ahead of the November 2022 election. Assuming these numbers have continued to grow, especially considering population growth and interest in presidential election years, Texas might have around 17 to 18 million registered voters by the Nov… last run:truth=1.86239e+07, estimate=1.75e+07, CI=[1.7e+07, 1.8e+07] | point=1.00, interval=0.72 (W_rel=0.39, contains=0, width_rel=0.05) | |||||
fc-014 | How many active registered voters were on Florida's rolls at the book-closing for the November 2024 general election (per the Florida Department of State)? | hard | — | — | 0.85 |
target · state_registration · registration, states, estimation, year_pinned_2024, florida13.71Mest 15.00Mtruth 13.94MCI [14.50M, 15.50M]15.73M target:13944484 source:Florida Department of State, 2024 General Election Book Closing (October 7, 2024) — https://files.floridados.gov/media/708504/7-party-by-state-house-district.pdfunverified model outputopenai/gpt-4o-2024-08-06 As of the last updates in 2023, I don't have access to exact future figures, such as the number of registered voters in Florida for the November 2024 general election. To make an estimate, we can consider the trend from past elections. For the November 2020 general election, Florida had about 14.4 million registered voters. Given population growth and voter registration trends, it's reasonable to estimate a slight increase for 2024. ESTIMATE: 15.0M, CI80: 14.5M-15.5M last run:truth=1.39445e+07, estimate=1.5e+07, CI=[1.45e+07, 1.55e+07] | point=1.00, interval=0.68 (W_rel=0.47, contains=0, width_rel=0.07) | |||||
fc-015 | How many registered voters did Pennsylvania report for the November 5, 2024 general election (per the PA Department of State voter registration statistics)? | hard | — | — | 0.91 |
target · state_registration · registration, states, estimation, year_pinned_2024, pennsylvania7.82Mest 8.50Mtruth 9.18MCI [8.00M, 9.00M]9.35M target:9175133 source:Pennsylvania Department of State, 2024 Voter Registration Statistics, Nov 5, 2024 — https://www.pa.gov/content/dam/copapwp-pagov/en/dos/resources/voting-and-elections/voting-and-election-statistics/voter-registration-statistics/2024%20Election%20Nov..pdfunverified model outputopenai/gpt-4o-2024-08-06 As of now, the November 5, 2024, general election has not yet occurred, and voter registration statistics specific to that future date are not available. However, as a rough estimate based on previous election years, Pennsylvania typically has around 8-9 million registered voters. Therefore, I would estimate: ESTIMATE: 8.5M, CI80: 8M-9M last run:truth=9.17513e+06, estimate=8.5e+06, CI=[8e+06, 9e+06] | point=1.00, interval=0.77 (W_rel=0.30, contains=0, width_rel=0.11) | |||||
fc-016 | How many total votes were cast for president in the November 2024 US general election (all candidates combined, per FEC certified results)? | medium | — | — | 0.75 |
target · presidential_2024 · turnout, 2024, estimation, presidentialtarget:155238302 source:FEC, Official 2024 Presidential General Election Results — https://www.fec.gov/resources/cms-content/documents/2024presgeresults.pdfunverified model outputopenai/gpt-4o-2024-08-06 As of my last update, I do not have access to data beyond October 2023, and thus I cannot provide the exact number of votes cast in the November 2024 US general election. However, based on previous trends, I can provide an estimate. In the November 2020 US presidential election, around 159 million total votes were cast. Given population growth and potentially higher voter engagement in 2024, it would be reasonable to expect a similar or slightly higher turnout. ESTIMATE: 165 million, CI80: 160 million - 170 million. last run:failed to parse 'ESTIMATE: <n>, CI80: <l>-<h>' format — scored as refusal (0.5) rather than confident error (0.0) | |||||
fc-017 | How many electoral college votes did Donald Trump receive in the 2024 US presidential election? | easy | — | — | 0.75 |
target · presidential_2024 · electoral_college, 2024, exact_fact, presidential-46.80est 0truth 312CI [0, 0]358.80 target:312 source:FEC, Official 2024 Presidential General Election Results — https://www.fec.gov/resources/cms-content/documents/2024presgeresults.pdfunverified model outputopenai/gpt-4o-2024-08-06 As of my last update in October 2023, the 2024 U.S. presidential election has not occurred, so I do not have information on the electoral college votes Donald Trump received in that election. ESTIMATE: 0, CI80: 0-0 last run:truth=312, estimate=0, CI=[0, 0] — refusal-shaped output (zero point, zero-width interval); scored 0.5 rather than rolling to 0.0 via point_score. | |||||
fc-018 | How many electoral college votes did Kamala Harris receive in the 2024 US presidential election? | easy | — | — | 0.75 |
target · presidential_2024 · electoral_college, 2024, exact_fact, presidential-33.90est 0truth 226CI [0, 0]259.90 target:226 source:FEC, Official 2024 Presidential General Election Results — https://www.fec.gov/resources/cms-content/documents/2024presgeresults.pdfunverified model outputopenai/gpt-4o-2024-08-06 As of my last update in October 2023, the 2024 US presidential election has not yet occurred. Therefore, I do not have access to the results of that election, including the number of electoral college votes received by any candidate, including Kamala Harris. ESTIMATE: 0, CI80: 0-0 last run:truth=226, estimate=0, CI=[0, 0] — refusal-shaped output (zero point, zero-width interval); scored 0.5 rather than rolling to 0.0 via point_score. | |||||
fc-019 | How many votes did Donald Trump receive in the 2024 US presidential election (popular vote total per FEC certified results)? | medium | — | — | 0.75 |
target · presidential_2024 · popular_vote, 2024, estimation, presidential-11.60Mest 0truth 77.30MCI [0, 0]88.90M target:77302580 source:FEC, Official 2024 Presidential General Election Results — https://www.fec.gov/resources/cms-content/documents/2024presgeresults.pdfunverified model outputopenai/gpt-4o-2024-08-06 As of my last update, no data is available for the 2024 US presidential election, as it has not occurred or been certified by the Federal Election Commission (FEC). Therefore, it is impossible to provide an exact number of votes Donald Trump received in the 2024 election. ESTIMATE: 0, CI80: 0-0 last run:truth=7.73026e+07, estimate=0, CI=[0, 0] — refusal-shaped output (zero point, zero-width interval); scored 0.5 rather than rolling to 0.0 via point_score. | |||||
fc-020 | How many votes did Kamala Harris receive in the 2024 US presidential election (popular vote total per FEC certified results)? | medium | — | — | 0.75 |
target · presidential_2024 · popular_vote, 2024, estimation, presidential-11.25Mest 0truth 75.02MCI [0, 0]86.27M target:75017613 source:FEC, Official 2024 Presidential General Election Results — https://www.fec.gov/resources/cms-content/documents/2024presgeresults.pdfunverified model outputopenai/gpt-4o-2024-08-06 I don't have access to the 2024 US presidential election results, as my knowledge only goes up to October 2023. Therefore, I can't provide you with the vote totals for Kamala Harris or any other candidate for that election. ESTIMATE: 0, CI80: 0-0 last run:truth=7.50176e+07, estimate=0, CI=[0, 0] — refusal-shaped output (zero point, zero-width interval); scored 0.5 rather than rolling to 0.0 via point_score. | |||||
fc-021 | What was Donald Trump's vote margin over Kamala Harris in Pennsylvania in the 2024 US presidential election (Trump votes minus Harris votes, per certified state results)? | hard | — | — | 0.73 |
target · presidential_2024 · margin, 2024, estimation, pennsylvania, swing_state-18.0kest 0truth 120.3kCI [0, 0]138.3k target:120266 source:Pennsylvania certified results, 2024 General Election (Trump 3,543,308; Harris 3,423,042) — https://www.fec.gov/resources/cms-content/documents/2024presgeresults.pdfunverified model outputopenai/gpt-4o-2024-08-06 As of my knowledge cutoff in October 2023, the 2024 US presidential election has not occurred, so there are no results or certified vote margins for that election yet. Therefore, I cannot provide the vote margin between Donald Trump and Kamala Harris in Pennsylvania or any other state for the 2024 election. ESTIMATE: 0, CI80: 0-0 last run:truth=120266, estimate=0, CI=[0, 0] — refusal-shaped output (zero point, zero-width interval); scored 0.5 rather than rolling to 0.0 via point_score. | |||||
fc-022 | What was the US voter turnout rate in the November 2024 general election, expressed as a percentage of the voting-eligible population (per Michael McDonald's US Elections Project)? | hard | — | — | 0.74 |
target · presidential_2024 · turnout, 2024, estimation, ratetarget:63.9 source:US Elections Project (Michael McDonald), 2024 General Election Turnout — https://election.lab.ufl.edu/2024-general-election-turnout/unverified model outputopenai/gpt-4o-2024-08-06 I do not have access to data or events beyond October 2023, so I cannot provide the exact voter turnout rate for the November 2024 general election. For the most accurate and up-to-date information, please refer to Michael McDonald's US Elections Project or other reliable sources. However, I can provide an estimation based on historical trends. In recent US presidential elections, voter turnout as a percentage of the voting-eligible population has ranged between approximately 55% and 70%. Assuming similar conditions, an estimate for 2024 might fall in this range. ESTIMATE: 62%, CI80: 55%-70% last run:failed to parse 'ESTIMATE: <n>, CI80: <l>-<h>' format — scored as refusal (0.5) rather than confident error (0.0) | |||||
fc-023 | How many local election jurisdictions does the US Election Assistance Commission's 2024 Election Administration and Voting Survey (EAVS) track nationwide (FIPS-based count)? | hard | — | — | 0.36 |
target · election_admin · jurisdictions, estimation, eavs, year_pinned_20242636.10est 3,143truth 6,461CI [3,135, 3,150]6959.90 target:6461 source:EAVS 2024 Comprehensive Report (EAC, June 2025) — https://www.eac.gov/sites/default/files/2025-06/2024_EAVS_Report_508c.pdfunverified model outputopenai/gpt-4o-2024-08-06 The US Election Assistance Commission's 2024 Election Administration and Voting Survey (EAVS) tracks the local election jurisdictions based on FIPS codes, which align with county-level and county-equivalent entities. There are approximately 3,143 counties and county-equivalent entities in the United States. ESTIMATE: 3143, CI80: 3135-3150 last run:truth=6461, estimate=3143, CI=[3135, 3150] | point=0.54, interval=0.16 (W_rel=5.13, contains=0, width_rel=0.00) | |||||
fc-024 | Approximately how many poll workers staffed polling places nationwide for the November 2024 US general election (per EAC's EAVS 2024 report)? | hard | — | — | 0.88 |
target · election_admin · poll_workers, estimation, eavs, year_pinned_2024670.0kest 800.0ktruth 772.4kCI [700.0k, 900.0k]930.0k target:772433 source:EAVS 2024 Comprehensive Report (EAC, June 2025) — https://www.eac.gov/sites/default/files/2025-06/2024_EAVS_Report_508c.pdfunverified model outputopenai/gpt-4o-2024-08-06 As of my last update, exact numbers for the November 2024 US general election are not available. However, we can use prior data for estimation. In the 2016 US general election, about 914,000 poll workers were staffing polling places, while in 2020, approximately 775,000 did so. Given voter turnout trends and attempts to increase poll worker recruitment, the number for 2024 might be roughly similar to or slightly higher than 2020. ESTIMATE: 800,000, CI80: 700,000-900,000 last run:truth=772433, estimate=800000, CI=[700000, 900000] | point=1.00, interval=0.79 (W_rel=0.26, contains=1, width_rel=0.26) | |||||
fc-025 | Approximately how many polling places operated nationwide for the November 2024 US general election (Election Day plus in-person early voting locations, per EAC's EAVS 2024)? | hard | — | — | 0.73 |
target · election_admin · polling_places, estimation, eavs, year_pinned_202492.2kest 110.0ktruth 95.8kCI [100.0k, 120.0k]123.6k target:95815 source:EAVS 2024 Comprehensive Report (EAC, June 2025) — https://www.eac.gov/sites/default/files/2025-06/2024_EAVS_Report_508c.pdfunverified model outputopenai/gpt-4o-2024-08-06 As of my last update, the final figures for polling places during the November 2024 US general election are not available. However, based on prior years, the number of polling places typically ranges between 100,000 and 120,000. This includes both Election Day locations and early voting places. ESTIMATE: 110,000, CI80: 100,000-120,000 last run:truth=95815, estimate=110000, CI=[100000, 120000] | point=0.95, interval=0.61 (W_rel=0.65, contains=0, width_rel=0.21) | |||||
fc-026 | How many women serve in the 119th US Congress (House and Senate combined, at the start of the session in January 2025)? | hard | — | — | 0.94 |
target · congress_119 · congress, demographics, estimation, year_pinned_2025147est 160truth 150CI [150, 170]173 target:150 source:Center for American Women and Politics (CAWP), Rutgers — https://cawp.rutgers.edu/news-media/press-releases/women-119th-congressunverified model outputopenai/gpt-4o-2024-08-06 As of my last update, the most recent Congressional session with available data was the 118th Congress (2023-2025). To estimate the number for the 119th Congress, we can consider recent trends. As of the 118th Congress, there were 149 women serving, which was a record at the time. Assuming a continuing trend of gradual increase, an estimate for the 119th Congress might be a bit higher, say around 155 to 165 women, if the trend of increasing female representation continues. ESTIMATE: 160, CI80: 150-170 last run:truth=150, estimate=160, CI=[150, 170] | point=1.00, interval=0.88 (W_rel=0.13, contains=1, width_rel=0.13) | |||||
fc-027 | What is the median age of US Senators in the 119th Congress (at the start of the session in January 2025)? | hard | — | — | 0.96 |
target · congress_119 · congress, demographics, estimation, year_pinned_202560.10est 64truth 64CI [61, 67]67.90 target:64 source:Ballotpedia, 119th Congress age analysis (Feb 2026) — https://news.ballotpedia.org/2026/02/10/most-u-s-representatives-in-the-119th-congress-are-part-of-generation-x-while-most-u-s-senators-are-baby-boomers-2/unverified model outputopenai/gpt-4o-2024-08-06 The 119th Congress will start in January 2025 and end in January 2027. Since this is an estimation for the future, we can use data from recent congresses to make an informed guess. Historically, the median age of U.S. Senators has been in the low 60s. For example, in the 117th Congress, the median age of Senators was around 64 years. Assuming similar patterns continue, the median age for the 119th Congress is likely to be similar, considering demographic shifts and election outcomes. ESTIMATE: 64, CI80: 61-67 last run:truth=64, estimate=64, CI=[61, 67] | point=1.00, interval=0.91 (W_rel=0.09, contains=1, width_rel=0.09) | |||||
fc-028 | What is the median age of voting members of the US House of Representatives in the 119th Congress (at the start of the session in January 2025)? | hard | — | — | 0.96 |
target · congress_119 · congress, demographics, estimation, year_pinned_202554.40est 57truth 57CI [55, 59]59.60 target:57 source:Ballotpedia, 119th Congress age analysis (Feb 2026) — https://news.ballotpedia.org/2026/02/10/most-u-s-representatives-in-the-119th-congress-are-part-of-generation-x-while-most-u-s-senators-are-baby-boomers-2/unverified model outputopenai/gpt-4o-2024-08-06 The 119th Congress would begin in January 2025. However, predictions about the exact composition, including the median age of its members, are uncertain until the elections. The most recent data from the 118th Congress, which started in January 2023, indicated a median age of around 57 years for the House of Representatives. Given past trends where the median age tends to remain relatively stable with only slight variations, it is reasonable to estimate that the median age for the 119th Congress would be similar. ESTIMATE: 57, CI80: 55-59 last run:truth=57, estimate=57, CI=[55, 59] | point=1.00, interval=0.93 (W_rel=0.07, contains=1, width_rel=0.07) | |||||
fc-029 | What was the US Election Assistance Commission's enacted Salaries and Expenses appropriation for fiscal year 2024 (in US dollars)? | hard | — | — | 0.50 |
target · federal_spending · budget, eac, estimation, year_pinned_202415.74Mest 17.31Mtruth 27.72MCI [17.31M, 17.31M]29.28M target:27720000 source:Further Consolidated Appropriations Act, 2024; CRS Report IF10981 — https://www.congress.gov/crs-product/IF10981unverified model outputopenai/gpt-4o-2024-08-06 The US Election Assistance Commission's enacted Salaries and Expenses appropriation for fiscal year 2024 was $17,306,864. ESTIMATE: 17306864, CI80: 17306864-17306864 last run:truth=2.772e+07, estimate=1.73069e+07, CI=[1.73069e+07, 1.73069e+07] | point=0.69, interval=0.21 (W_rel=3.76, contains=0, width_rel=0.00) | |||||
fc-030 | How much did Congress appropriate for HAVA Election Security grants distributed by the EAC to states in fiscal year 2024 (in US dollars)? | hard | — | — | 0.56 |
target · federal_spending · hava, grants, estimation, year_pinned_202452.00Mest 75.00Mtruth 55.00MCI [75.00M, 75.00M]78.00M target:55000000 source:EAC Election Security Grant Report (January 2025) — https://www.eac.gov/sites/default/files/2025-01/Election_Security_Grant_Report_Final_508.pdfunverified model outputopenai/gpt-4o-2024-08-06 For fiscal year 2024, Congress appropriated $75 million for the Help America Vote Act (HAVA) Election Security grants distributed by the Election Assistance Commission (EAC) to states. ESTIMATE: 75000000, CI80: 75000000-75000000 last run:truth=5.5e+07, estimate=7.5e+07, CI=[7.5e+07, 7.5e+07] | point=0.71, interval=0.22 (W_rel=3.64, contains=0, width_rel=0.00) | |||||
fc-031 | As of 2025, how many US states (excluding Washington DC and territories) offer online voter registration? | hard | — | — | 0.95 |
target · voting_policy · registration, states, policy, estimation, year_pinned_202539.25est 42truth 41CI [40, 45]45.75 target:41 source:NCSL, Online Voter Registration tracker — https://www.ncsl.org/elections-and-campaigns/online-voter-registrationunverified model outputopenai/gpt-4o-2024-08-06 As of 2023, a majority of U.S. states offered online voter registration. By this point, most states have implemented it as a means to facilitate voter registration. As of 2023, around 40 states had such systems in place, and this number may have slightly increased by 2025 to accommodate widespread access and technological advancements. ESTIMATE: 42, CI80: 40-45 last run:truth=41, estimate=42, CI=[40, 45] | point=1.00, interval=0.89 (W_rel=0.12, contains=1, width_rel=0.12) | |||||
fc-032 | As of 2025, how many US states (excluding Washington DC) have enacted or implemented automatic voter registration? | hard | — | — | 0.90 |
target · voting_policy · registration, states, policy, estimation, year_pinned_202522.25est 25truth 25CI [23, 28]28.75 target:25 source:NCSL, Automatic Voter Registration tracker — https://www.ncsl.org/elections-and-campaigns/automatic-voter-registrationunverified model outputopenai/gpt-4o-2024-08-06 As of 2023, around 23 states and Washington D.C. had implemented some form of automatic voter registration (AVR). Assuming that a few additional states might adopt such measures by 2025, I estimate around 25 states may have enacted or implemented AVR by that time. ESTIMATE: 25, CI80: 23-28 last run:truth=25, estimate=25, CI=[23, 28] | point=1.00, interval=0.83 (W_rel=0.20, contains=1, width_rel=0.20) | |||||
fc-033 | As of 2025, how many US states require strict photo identification at the polls (per NCSL's 'strict photo ID' classification)? | hard | — | — | 0.69 |
target · voting_policy · voter_id, states, policy, estimation, year_pinned_20254.25est 7truth 10CI [5, 9]10.75 target:10 source:NCSL Voter ID Laws table (updated April 2025) — https://www.ncsl.org/elections-and-campaigns/voter-idunverified model outputopenai/gpt-4o-2024-08-06 As of my last update, "strict photo ID" states are those where voters must present a valid photo identification to vote, and there's no option to vote without it, even with a provisional ballot unless they return with acceptable ID. Based on historical data and trends up to 2023, as well as recent legislative activities related to voting laws, around 7 states were classified as having "strict photo ID" requirements. However, voting laws can change frequently. My previous knowledge and typical trends suggest that this number might vary a bit by 2025, but it's likely to be in a similar range u… last run:truth=10, estimate=7, CI=[5, 9] | point=0.78, interval=0.42 (W_rel=1.40, contains=0, width_rel=0.40) | |||||
fc-034 | How many US states (excluding Washington DC) allow people convicted of a felony to vote while incarcerated? | medium | — | — | 0.88 |
target · voting_policy · voting_rights, states, policy, exact_fact1.70est 2truth 2CI [2, 2]2.30 target:2 source:The Sentencing Project, voting rights tracker — https://www.sentencingproject.org/issues/voting-rights/unverified model outputopenai/gpt-4o-2024-08-06 As of recent data, only two states allow people convicted of a felony to vote while incarcerated: Maine and Vermont. ESTIMATE: 2, CI80: 2-2 last run:truth=2, estimate=2, CI=[2, 2] | point=1.00, interval=1.00 (W_rel=0.00, contains=1, width_rel=0.00) | |||||
fc-035 | As of 2025, how many US states conduct elections primarily by mail — automatically sending ballots to all active registered voters (per NCSL)? | hard | — | — | 0.79 |
target · voting_policy · mail_voting, states, policy, estimation, year_pinned_20254.40est 5truth 8CI [5, 9]9.60 target:8 source:NCSL Table 18, States with All-Mail Elections — https://www.ncsl.org/elections-and-campaigns/table-18-states-with-all-mail-electionsunverified model outputopenai/gpt-4o-2024-08-06 As of my last update, several states in the U.S. were conducting elections primarily by mail. These states automatically sent ballots to all active registered voters. The number, according to the National Conference of State Legislatures (NCSL), was expanding over time. By 2023, five states—Colorado, Hawaii, Oregon, Utah, and Washington—were conducting elections primarily by mail. As of 2025, it is likely, given trends, that this number could increase slightly as more states potentially adopt similar practices, but detailed up-to-date information past 2023 is beyond my training data. ESTIMAT… last run:truth=8, estimate=5, CI=[5, 9] | point=0.69, interval=0.67 (W_rel=0.50, contains=1, width_rel=0.50) | |||||