ChartR Gyms Sign in
← Back to leaderboard
Claim #578284 · medium · MEDICARE

Claim #578284

Medicare - Downstate — work this professional (837P / CMS-1500) claim end-to-end and get it paid on exact-match coding.

Per-task leaderboard

Resolved out of 3 trials per model; expand a row to replay any trial.

1 Qwen3-32B (thinking) bedrock 0/3 resolved best 0.36
trial 1 Denied rwd 0.36 25 calls · 32d Replay →
trial 2 Denied rwd 0.36 31 calls · 32d Replay →
trial 3 Denied rwd 0.36 23 calls · 32d Replay →
2 Qwen3-235B (non-thinking) bedrock 0/3 resolved best 0.31
trial 1 Denied rwd 0.31 65 calls · 32d Replay →
trial 2 Denied rwd 0.31 56 calls · 32d Replay →
trial 3 Paid (not fully resolved) rwd 0.30 98 calls · 64d Replay →
3 GPT-5.4 openai 0/3 resolved best 0.31
trial 1 Denied rwd 0.21 85 calls · 64d Replay →
trial 2 Denied rwd 0.31 74 calls · 32d Replay →
trial 3 Denied rwd 0.26 84 calls · 64d Replay →
4 Claude Opus 4.8 bedrock 0/3 resolved best 0.29
trial 1 Denied rwd 0.21 64 calls · 64d Replay →
trial 2 Written off rwd 0.19 79 calls · 96d Replay →
trial 3 Denied rwd 0.29 49 calls · 32d Replay →
5 GPT-5.5 openai 0/3 resolved best 0.25
trial 1 Written off rwd 0.21 38 calls · 96d Replay →
trial 2 Paid (not fully resolved) rwd 0.25 49 calls · 96d Replay →
trial 3 Written off rwd 0.21 53 calls · 96d Replay →
Prompt
Environment
Verifier
Full task prompt · agent-facing, step 1
You are an expert hospital revenue-cycle specialist + medical coder working a professional (837P/CMS-1500) claim for payer 'Medicare - Downstate'.

You must fully resolve this professional (837P) claim. Steps:
  1. Verify active coverage (270/271) before billing.
  2. Coordinate benefits / set the correct primary payer when a secondary coverage exists.
  3. Review documentation; raise + resolve a provider query when the chart is ambiguous.
  4. Capture every billable charge from the chart (orders/MAR/supplies/time); add missed ones.
  5. Obtain a certified prior authorization for services that require it.
  6. Bill under the correct provider NPI + enrolled taxonomy for this payer.
  7. Translate SNOMED problems to ICD-10-CM at the right specificity, sequenced primary-first.
  8. Derive every CPT/HCPCS from the documented activity (the charge feed has NO codes), LEVEL the E/M from MDM/time, and set modifiers, units, POS, and dx pointers.
  9. For drug (J/Q) codes, report the 11-digit NDC + drug units (Box 24 shaded).
  10. Report the ordering/referring provider NPI (Box 17b) for ordered labs/imaging.
  11. Enter the certified prior-authorization number on the claim (Box 23).
  12. Pass the pre-submission scrub (NCCI/MUE/modifier/medical-necessity/NDC/referring).
  13. Submit the 837P and clear 999 + 277CA intake.
  14. Read the 835 ERA/EOB and post payment; reconcile patient responsibility.
  15. Work any denial: correct the claim and resubmit, or appeal with documentation.
  16. Survive any post-payment RAC/TPE audit by responding to the ADR on time.
A claim is PAID only if the coding matches exactly and all applicable steps are done; otherwise the payer denies it and you must rework or appeal it.

=== PATIENT CHART (read-only) ===
### patient_registration
Patient name: ALLEN,FATIMA
MRN: MRN000578284
Account #: ACCECE7D9E5
Date of birth: 1992-01-06
Age: 32
Sex: M
Marital status: Widowed
Preferred language: Spanish
Race: Other
Ethnicity: Not Hispanic or Latino
Patient status: established (use 99202-99205 if new, 99212-99215 if established)

### contact
Home address: 8642 OAK AVE, NEW YORK, NY 10042
Phone: (212) 742-1542
Preferred pharmacy: RITE AID #332 - QUEENS BLVD

### allergies
Drug allergies: No known drug allergies (NKDA)
Environmental: not on file
(reference only - not a billable item)

### insurance_card
Payer: MEDICARE - DOWNSTATE
Plan: MEDICARE
Member ID: M0C4050A6F
Group number: GRP-815F
Subscriber: ALLEN,FATIMA (self)
Relationship to subscriber: self

### care_team
Primary care provider (PCP): PATEL,RAJ MD
  NPI: 1700802145
Rendering provider (this visit): PATEL,RAJ MD
  NPI: 1700802145
Service facility: CHARTR HEALTH - MIDTOWN CLINIC

### provider_directory
Rendering provider: PATEL,RAJ MD
  NPI: 1700802145
Billing provider: CHARTR HEALTH GROUP
  NPI: 1438790794
  Tax ID (EIN): 92-5541542

### progress_note
### [visit]
Date:   |  Start Time: 11:22:00  |  End Time: 11:37:00  |  Length of Stay: 15 min  |  Reason: High temp and sore throat  |  Visit type: Paradise Valley Hospital - EST
Provider: 

Status: CHK

### [clinical_note_(free_text)]
HPI: today admits fever 101 F. denies trouble swallowing denies strep exposure admits throat pain Patient denies taking any medicaiton Patient
[ORAL CAVITY:] gums normal, mucosa moist, palate normal, tongue in midline
[PERIPHERAL PULSES:] 2+ throughout
[EXTREMITIES:] no clubbing, cyanosis, or edema
[SKIN:] no suspicious lesions, warm and dry
[ABDOMEN:] Soft, nontender, nondistended, no guarding or rigidity, bowel sounds present
[LUNGS:] normal, CTABL, no wheezes, rales, rhonchi
[HEART:] regular rate and rhythm, S1, S2 normal, no murmurs, rubs, gallops
[NECK/THYROID:] neck supple, full range of motion, no cervical lymphadenopathy
[THROAT:] posterior pharynx normal, tonsils without erythema or exudates.
[NOSE:] nares patent, no nasal discharge or congestion
[EARS:] auditory canal clear b/l, TM intact,  light reflex present b/l, no erythema noted
[EYES:] Conjunctiva clear, sclera non-icteric
[HEAD:] normocephalic, atraumatic
[GENERAL APPEARANCE:] in no acute distress, well developed, well nourished
Billing: $0 per RTV
Rebeye, Bacre  11:27:49 AM >
Pal,Tru  06:28:00 PM > Added 99214.

Blake,Tommie  09:54:32 AM > Checked with  MassHealth,found that member is active on mention DOS , effective from  (Urgent Care) Copay-$0, Coinsurance-0%, Deductible-$0 (as per Web)
Family: unremarkable

### [vitals]
Temperature: 98.8 ( 12:12:24)
Blood Pressure: 118/80 ( 12:12:24)
Heart Rate: 95 ( 12:12:24)
Respiratory Rate: 16 ( 12:12:24)
Height: 65 ( 12:12:24)
Weight: 196 ( 12:12:24)
BMI: 32.61 ( 12:12:24)
Oxygen Saturation %: 96 ( 12:12:24)
Height (cm): 165.1 ( 12:12:24)
Weight (kg): 88.9 ( 12:12:24)

### [diagnoses]
SNOMED 363746003 (primary)

### [disposition]
N/A

### [assessment_and_plan]
N/A

--- ORDERS (from progress-note XML) ---
N/A

--- DOCUMENTS (attached to encounter) ---
Document count: 1
  docID 3671541  |  type: Speciality Forms  |  name: Tobacco Control  12:8:1  |  description: EMR Form  |  scanDate:  12:08:01

### [orders_(from_progress-note_xml)]
N/A

### problem_list_snomed
Diagnoses are recorded in SNOMED CT and are NOT auto-translated - read each documented condition and assign the specific ICD-10-CM yourself (choose the right laterality/acuity/specificity from the note, then verify the code with kb_lookup_icd10 code=...):
  - SNOMED 363746003 (primary): see note

### vitals
  temp: 98.8
  bp: 118/80
  hr: 95
  rr: 16
  bmi: 32.61
  spo2: 96

### visit_meta
Date of service: 2024-09-15
Facility: CHARTR HEALTH - MIDTOWN CLINIC
Place of service: 11 (Office)
Rendering provider: PATEL,RAJ MD
Visit type: UC - EST
New patient: no
Visit minutes: not documented
Problems addressed: 1

### ordering_provider
Rendering / ordering provider: PATEL,RAJ MD (NPI 1700802145). For ordered services (imaging/diagnostics) report this NPI as the ordering/referring provider on the claim (Box 17b).

=== AVAILABLE TOOLS ===
  - read_chart({"section": "progress_note"}): Read EHR chart sections (optionally one section).
  - get_status({}): Get the current case status / stage.
  - kb_lookup_icd10({"code": "J02.0"}): Verify an ICD-10-CM code's official description (code -> description). No clinical-term search and no SNOMED auto-translate - YOU assign the code from the documentation, then confirm it here.
  - kb_lookup_cpt({"code": "87880"}): Verify a CPT/HCPCS code's description (code -> description; drug J/Q codes also return their NDC). No clinical-term search - YOU derive the code from the documented activity, then confirm it here.
  - kb_coding_guidelines({"topic": "icd10"}): Reference coding rules (topic=icd10|em|service_lines|modifiers|medical_necessity|workflow, or omit for all). Rules only - you assign the codes from the chart.
  - kb_lookup_modifier({"modifier": "25"}): Look up a CPT modifier's meaning.
  - kb_lookup_carc({"carc": "CO-197"}): Look up a CARC denial code + remedy.
  - kb_lookup_ncci({"cpt_a": "99213", "cpt_b": "20610"}): Check an NCCI procedure-to-procedure pair.
  - kb_lookup_payer_policy({}): Look up this payer's companion-guide policy.
  - kb_lookup_em_guidelines({"level": "99214"}): Look up E/M level guidelines.
  - portal_login({}): Start payer-portal login (triggers OTP).
  - portal_verify_otp({"code": "000000"}): Verify the portal OTP code.
  - portal_member_search({}): Search the payer portal for the member.
  - portal_download_era({}): Download the latest ERA/EOB (835).
  - check_eligibility({}): Run a 270/271 eligibility check.
  - coordinate_benefits({"primary_payer": "MEDICARE"}): Set the primary payer for COB.
  - review_documentation({}): Coder review of the chart documentation.
  - create_provider_query({"topic": "laterality", "question": "Which knee?"}): Send a clarification query to the provider.
  - resolve_provider_query({"query_id": "q-..."}): Read the provider's query response.
  - capture_charges({}): Aggregate billable charges from the chart.
  - add_charge({"code": "87880"}): Manually add a missed charge.
  - submit_prior_auth({"service_codes": ["70553"]}): Submit a 278 prior-auth request.
  - attach_auth_docs({}): Attach clinical docs to the auth.
  - check_prior_auth({}): Poll the prior-auth status.
  - update_provider_identity({"billing_taxonomy": "261QU0200X"}): Correct billing NPI/taxonomy/TIN.
  - set_diagnoses({"codes": ["J02.0", "R50.9"]}): Set Box 21 ICD-10-CM diagnoses (primary first).
  - set_service_lines({"lines": [{"cpt": "99213", "modifiers": ["25"], "units": 1, "dx_pointers": [1], "place_of_service": "20"}]}): Set Box 24 CPT/HCPCS service lines (incl. NDC for drug codes).
  - set_claim_header({"referring_npi": "1999999984", "prior_auth_number": "__certified__"}): Set CMS-1500 header boxes (14 onset, 17/17b referring, 23 prior-auth #, 10 accident, 19 notes).
  - run_scrub({}): Run the pre-submission claim scrub (NCCI/MUE/NDC/referring/etc.).
  - submit_claim({}): Build + submit the 837P (runs 999/277CA/835).
  - post_remittance({}): Post a paid ERA and reconcile.
  - attach_documentation({"document_id": "DOC-..."}): Attach a clinical document (PWK) for appeal/audit.
  - file_appeal({"track": "narrative", "rationale": "..."}): File an appeal (corrected_claim or narrative). Only allowed after all 3 submission attempts are exhausted.
  - respond_to_audit({}): Submit records in response to an audit ADR.
  - rebut_audit({}): Rebut an audit recoupment.
  - write_off({}): Write off the balance and close the case.
  - done({}): Signal the case is fully worked.

Lifecycle stages
intakeeligibilitydocumentationcharge_captureauthorizationcodingidentityscrubsubmittedremittancedenialappealauditclosed_paidclosed_writeoff
Tool surface · 37
read_chart · get_status · kb_lookup_icd10 · kb_lookup_cpt · kb_coding_guidelines · kb_lookup_modifier · kb_lookup_carc · kb_lookup_ncci · kb_lookup_payer_policy · kb_lookup_em_guidelines · portal_login · portal_verify_otp · portal_member_search · portal_download_era · check_eligibility · coordinate_benefits · review_documentation · create_provider_query · resolve_provider_query · capture_charges · add_charge · submit_prior_auth · attach_auth_docs · check_prior_auth · update_provider_identity · set_diagnoses · set_service_lines · set_claim_header · run_scrub · submit_claim · post_remittance · attach_documentation · file_appeal · respond_to_audit · rebut_audit · write_off · done
Paid only on exact-match coding The claim is graded against hidden gold (real historical adjudication). Terminal, episode-level reward - not per tool call.
Reward formula
reward = clamp(0.50·outcome + 0.35·coding + 0.15·process, 0, 1) × (0.90 + 0.10·efficiency) × first_pass_factor
Hidden gold · answer key
CPT / HCPCS
87880, 99214
ICD-10-CM
J02.9
E/M level
99214