ChartR Gyms Sign in
← Back to leaderboard
Claim #73022 · easy · MEDICAID

Claim #73022

METROPLUS HEALTH PLAN GR — work this professional (837P / CMS-1500) claim end-to-end and get it paid on exact-match coding.

Per-task leaderboard

Resolved out of 3 trials per model; expand a row to replay any trial.

1 GPT-5.4 openai 0/3 resolved best 0.28
trial 1 Written off rwd 0.16 82 calls · 96d Replay →
trial 2 Denied rwd 0.28 86 calls · 74d Replay →
trial 3 Written off rwd 0.15 93 calls · 96d Replay →
2 GPT-5.5 openai 0/3 resolved best 0.26
trial 1 Written off rwd 0.17 46 calls · 102d Replay →
trial 2 Written off rwd 0.26 33 calls · 100d Replay →
trial 3 Written off rwd 0.17 40 calls · 96d Replay →
3 Qwen3-32B (thinking) bedrock 0/3 resolved best 0.25
trial 1 Denied rwd 0.25 24 calls · 32d Replay →
trial 2 Denied rwd 0.25 24 calls · 32d Replay →
trial 3 Written off rwd 0.16 42 calls · 96d Replay →
4 Qwen3-235B (non-thinking) bedrock 0/3 resolved best 0.25
trial 1 Denied rwd 0.25 67 calls · 32d Replay →
trial 2 Denied rwd 0.24 68 calls · 32d Replay →
trial 3 Denied rwd 0.24 83 calls · 36d Replay →
5 Claude Opus 4.8 bedrock 0/3 resolved best 0.18
trial 1 Written off rwd 0.16 68 calls · 96d Replay →
trial 2 Denied rwd 0.18 68 calls · 64d Replay →
trial 3 Denied rwd 0.18 68 calls · 64d Replay →
Prompt
Environment
Verifier
Full task prompt · agent-facing, step 1
You are an expert hospital revenue-cycle specialist + medical coder working a professional (837P/CMS-1500) claim for payer 'METROPLUS HEALTH PLAN GR'.

You must fully resolve this professional (837P) claim. Steps:
  1. Verify active coverage (270/271) before billing.
  2. Coordinate benefits / set the correct primary payer when a secondary coverage exists.
  3. Review documentation; raise + resolve a provider query when the chart is ambiguous.
  4. Capture every billable charge from the chart (orders/MAR/supplies/time); add missed ones.
  5. Obtain a certified prior authorization for services that require it.
  6. Bill under the correct provider NPI + enrolled taxonomy for this payer.
  7. Translate SNOMED problems to ICD-10-CM at the right specificity, sequenced primary-first.
  8. Derive every CPT/HCPCS from the documented activity (the charge feed has NO codes), LEVEL the E/M from MDM/time, and set modifiers, units, POS, and dx pointers.
  9. For drug (J/Q) codes, report the 11-digit NDC + drug units (Box 24 shaded).
  10. Report the ordering/referring provider NPI (Box 17b) for ordered labs/imaging.
  11. Enter the certified prior-authorization number on the claim (Box 23).
  12. Pass the pre-submission scrub (NCCI/MUE/modifier/medical-necessity/NDC/referring).
  13. Submit the 837P and clear 999 + 277CA intake.
  14. Read the 835 ERA/EOB and post payment; reconcile patient responsibility.
  15. Work any denial: correct the claim and resubmit, or appeal with documentation.
  16. Survive any post-payment RAC/TPE audit by responding to the ADR on time.
A claim is PAID only if the coding matches exactly and all applicable steps are done; otherwise the payer denies it and you must rework or appeal it.

=== PATIENT CHART (read-only) ===
### patient_registration
Patient name: PATEL,JAMES
MRN: MRN000073022
Account #: ACCF8988C7D
Date of birth: 2004-11-26
Age: 19
Sex: M
Marital status: Divorced
Preferred language: English
Race: Other
Ethnicity: Declined
Patient status: new (use 99202-99205 if new, 99212-99215 if established)

### contact
Home address: 8904 PARK BLVD, NEW YORK, NY 10004
Phone: (212) 404-2804
Preferred pharmacy: RITE AID #332 - QUEENS BLVD

### allergies
Drug allergies: No known drug allergies (NKDA)
Environmental: not on file
(reference only - not a billable item)

### insurance_card
Payer: METROPLUS HEALTH PLAN GR
Plan: MEDICAID
Member ID: ME64F16948
Group number: GRP-DB7A
Subscriber: PATEL,JAMES (self)
Relationship to subscriber: self

### care_team
Primary care provider (PCP): SMITH,JAMES MD
  NPI: 1083201557
Rendering provider (this visit): KIM,SARA NP
  NPI: 1255710086
Service facility: CHARTR HEALTH - RIVERSIDE FAMILY MEDICINE

### provider_directory
Rendering provider: KIM,SARA NP
  NPI: 1255710086
Billing provider: CHARTR HEALTH GROUP
  NPI: 1047599628
  Tax ID (EIN): 84-3942804

### progress_note
### [visit]
Date:   |  Start Time: 17:19:00  |  End Time: 17:34:00  |  Length of Stay: 15 min  |  Reason: Plan B  |  Visit type: UC - NEW
Provider: 

Status: CHK

### [clinical_note_(free_text)]
History: PT come in today request Plan B medication
[EXTREMITIES:] no clubbing, cyanosis, or edema
[SKIN:] warm and dry, no suspicious lesions
[NEUROLOGIC:] nonfocal, motor strength normal upper and lower extremities, sensory exam intact
[ABDOMEN:] soft, nontender, nondistended, bowel sounds present, normal
[LUNGS:] clear to auscultation bilaterally, no wheezes, rales, rhonchi
[HEART:] regular rate and rhythm, S1, S2 normal, no murmurs
[NECK/THYROID:] neck supple, full range of motion, no cervical lymphadenopathy
[EYES:] pupils equal, round, reactive to light and accommodation, sclera non-icteric, upper eyelids normal, lower eyelids normal
[HEAD:] normocephalic, atraumatic
[GENERAL APPEARANCE:] well developed, well nourished, in no acute distress
Billing: $0 copay as per RTV, no collection made
Jinks, Monika  05:20:17 PM > Kermode,Ashby  11:08:53 AM > No Change.
Garner,Pat   6:43:45 PM > 
Checked with Medi-Cal, found that member is active  on DOS, effective from , Copay-$0, Coinsurance-0%, Deductible-$0
PrevMed: Drink plenty of fluids and stay hydrated. 
Get plenty of rest. 
If symptoms worsen then go to the ER for further evaluation. 
Follow up with PCP in 2-3 days

### [vitals]
Temperature:  ( 17:41:39)
Blood Pressure:  ( 17:41:39)
Heart Rate:  ( 17:41:39)
Respiratory Rate:  ( 17:41:39)
Height:  ( 17:41:39)
Weight:  ( 17:41:39)
BMI:  ( 17:41:39)
Height (cm):  ( 17:41:39)
Weight (kg):  ( 17:41:39)

### [diagnoses]
SNOMED 305060004 (primary)

### [disposition]
N/A

### [assessment_and_plan]
N/A

--- ORDERS (from progress-note XML) ---
N/A

--- DOCUMENTS (attached to encounter) ---
Document count: 2
  docID 132405  |  type: Speciality Forms  |  name: Tobacco Control  17:43:0  |  description: EMR Form  |  scanDate:  17:43:00
  docID 132406  |  type: Speciality Forms  |  name: Audit-C  17:43:19  |  description: EMR Form  |  scanDate:  17:43:19

### [orders_(from_progress-note_xml)]
N/A

### problem_list_snomed
Diagnoses are recorded in SNOMED CT and are NOT auto-translated - read each documented condition and assign the specific ICD-10-CM yourself (choose the right laterality/acuity/specificity from the note, then verify the code with kb_lookup_icd10 code=...):
  - SNOMED 305060004 (primary): see note

### visit_meta
Date of service: 2024-09-15
Facility: CHARTR HEALTH - RIVERSIDE FAMILY MEDICINE
Place of service: 11 (Office)
Rendering provider: KIM,SARA NP
Visit type: UC - NEW
New patient: yes
Visit minutes: not documented
Problems addressed: 1

### ordering_provider
Rendering / ordering provider: KIM,SARA NP (NPI 1255710086). For ordered services (imaging/diagnostics) report this NPI as the ordering/referring provider on the claim (Box 17b).

=== AVAILABLE TOOLS ===
  - read_chart({"section": "progress_note"}): Read EHR chart sections (optionally one section).
  - get_status({}): Get the current case status / stage.
  - kb_lookup_icd10({"code": "J02.0"}): Verify an ICD-10-CM code's official description (code -> description). No clinical-term search and no SNOMED auto-translate - YOU assign the code from the documentation, then confirm it here.
  - kb_lookup_cpt({"code": "87880"}): Verify a CPT/HCPCS code's description (code -> description; drug J/Q codes also return their NDC). No clinical-term search - YOU derive the code from the documented activity, then confirm it here.
  - kb_coding_guidelines({"topic": "icd10"}): Reference coding rules (topic=icd10|em|service_lines|modifiers|medical_necessity|workflow, or omit for all). Rules only - you assign the codes from the chart.
  - kb_lookup_modifier({"modifier": "25"}): Look up a CPT modifier's meaning.
  - kb_lookup_carc({"carc": "CO-197"}): Look up a CARC denial code + remedy.
  - kb_lookup_ncci({"cpt_a": "99213", "cpt_b": "20610"}): Check an NCCI procedure-to-procedure pair.
  - kb_lookup_payer_policy({}): Look up this payer's companion-guide policy.
  - kb_lookup_em_guidelines({"level": "99214"}): Look up E/M level guidelines.
  - portal_login({}): Start payer-portal login (triggers OTP).
  - portal_verify_otp({"code": "000000"}): Verify the portal OTP code.
  - portal_member_search({}): Search the payer portal for the member.
  - portal_download_era({}): Download the latest ERA/EOB (835).
  - check_eligibility({}): Run a 270/271 eligibility check.
  - coordinate_benefits({"primary_payer": "MEDICARE"}): Set the primary payer for COB.
  - review_documentation({}): Coder review of the chart documentation.
  - create_provider_query({"topic": "laterality", "question": "Which knee?"}): Send a clarification query to the provider.
  - resolve_provider_query({"query_id": "q-..."}): Read the provider's query response.
  - capture_charges({}): Aggregate billable charges from the chart.
  - add_charge({"code": "87880"}): Manually add a missed charge.
  - submit_prior_auth({"service_codes": ["70553"]}): Submit a 278 prior-auth request.
  - attach_auth_docs({}): Attach clinical docs to the auth.
  - check_prior_auth({}): Poll the prior-auth status.
  - update_provider_identity({"billing_taxonomy": "261QU0200X"}): Correct billing NPI/taxonomy/TIN.
  - set_diagnoses({"codes": ["J02.0", "R50.9"]}): Set Box 21 ICD-10-CM diagnoses (primary first).
  - set_service_lines({"lines": [{"cpt": "99213", "modifiers": ["25"], "units": 1, "dx_pointers": [1], "place_of_service": "20"}]}): Set Box 24 CPT/HCPCS service lines (incl. NDC for drug codes).
  - set_claim_header({"referring_npi": "1999999984", "prior_auth_number": "__certified__"}): Set CMS-1500 header boxes (14 onset, 17/17b referring, 23 prior-auth #, 10 accident, 19 notes).
  - run_scrub({}): Run the pre-submission claim scrub (NCCI/MUE/NDC/referring/etc.).
  - submit_claim({}): Build + submit the 837P (runs 999/277CA/835).
  - post_remittance({}): Post a paid ERA and reconcile.
  - attach_documentation({"document_id": "DOC-..."}): Attach a clinical document (PWK) for appeal/audit.
  - file_appeal({"track": "narrative", "rationale": "..."}): File an appeal (corrected_claim or narrative). Only allowed after all 3 submission attempts are exhausted.
  - respond_to_audit({}): Submit records in response to an audit ADR.
  - rebut_audit({}): Rebut an audit recoupment.
  - write_off({}): Write off the balance and close the case.
  - done({}): Signal the case is fully worked.

Lifecycle stages
intakeeligibilitydocumentationcharge_captureauthorizationcodingidentityscrubsubmittedremittancedenialappealauditclosed_paidclosed_writeoff
Tool surface · 37
read_chart · get_status · kb_lookup_icd10 · kb_lookup_cpt · kb_coding_guidelines · kb_lookup_modifier · kb_lookup_carc · kb_lookup_ncci · kb_lookup_payer_policy · kb_lookup_em_guidelines · portal_login · portal_verify_otp · portal_member_search · portal_download_era · check_eligibility · coordinate_benefits · review_documentation · create_provider_query · resolve_provider_query · capture_charges · add_charge · submit_prior_auth · attach_auth_docs · check_prior_auth · update_provider_identity · set_diagnoses · set_service_lines · set_claim_header · run_scrub · submit_claim · post_remittance · attach_documentation · file_appeal · respond_to_audit · rebut_audit · write_off · done
Paid only on exact-match coding The claim is graded against hidden gold (real historical adjudication). Terminal, episode-level reward - not per tool call.
Reward formula
reward = clamp(0.50·outcome + 0.35·coding + 0.15·process, 0, 1) × (0.90 + 0.10·efficiency) × first_pass_factor
Hidden gold · answer key
CPT / HCPCS
99203
ICD-10-CM
Z32.00
E/M level
99203