Skip to content

The Wall of Shame

If your api is on this list: fix your spec

Every generated SDK: ours, the vendor's, the one you'd write; is only ever as good as the api spec its built from. Most of these specs aren't generated from the source and regularly drift from the actual implementation. We maintain a list of who we have to patch the most so we can hopefully pressure these providers to fix their source of truth.

Ranked by fixes per 100 operations, so a huge API isn't punished for being huge. Providers with no patches at all are in the honour roll below; A HUGE thank you to the providers we don't have to patch. Numbers come from packages/*/patches at build time.

41,532spec fixes carried
4,143patch files
58providers patched
0clean & used in Alchemy

Honour roll

Zero patches, and used in Alchemy.

Used by real Alchemy resources today and don't need their spec fixed. The API spec generated a working SDK as published; which is what a spec is supposed to do.

  • Nobody. Every package Alchemy uses has needed at least one spec fix. The bar is here; nobody has cleared it yet.

Worst offenders

Most patched, per 100 operations.

  1. 01
    resend693.5 fixes / 100 ops
    957 fixes138 operations6 patch filessee patches →
    935 added11 removed11 replaced
  2. 02
    cloudflareused in Alchemy588.7 fixes / 100 ops
    18,414 fixes3,128 operations2,896 patch filessee patches →
    7,601 moved5,251 replaced4,916 added634 removed12 copied
  3. 03
    rivet463.2 fixes / 100 ops
    88 fixes19 operations21 patch filessee patches →
    88 added
  4. 04
    technitium309.4 fixes / 100 ops
    393 fixes127 operations10 patch filessee patches →
    378 added13 replaced2 removed
  5. 05
    convex248.1 fixes / 100 ops
    196 fixes79 operations9 patch filessee patches →
    170 added18 replaced8 removed
  6. 06
    posthog234.0 fixes / 100 ops
    6,136 fixes2,622 operations234 patch filessee patches →
    5,125 removed996 added9 moved6 replaced
  7. 07
    fly-ioused in Alchemy176.4 fixes / 100 ops
    307 fixes174 operations35 patch filessee patches →
    263 added22 removed17 replaced4 moved1 tested
  8. 08
    axiomused in Alchemy160.7 fixes / 100 ops
    143 fixes89 operations9 patch filessee patches →
    75 added61 removed7 replaced
  9. 09
    workos159.5 fixes / 100 ops
    429 fixes269 operations3 patch filessee patches →
    426 removed3 added
  10. 10
    archil143.8 fixes / 100 ops
    69 fixes48 operations5 patch filessee patches →
    40 replaced29 added
  11. 11
    doppler136.0 fixes / 100 ops
    189 fixes139 operations9 patch filessee patches →
    127 added43 removed16 replaced3 moved
  12. 12
    kubernetes130.1 fixes / 100 ops
    1,509 fixes1,160 operations88 patch filessee patches →
    1,509 added
  13. 13
    boat-dev124.1 fixes / 100 ops
    144 fixes116 operations26 patch filessee patches →
    139 added3 removed2 replaced
  14. 14
    tailscale109.7 fixes / 100 ops
    102 fixes93 operations11 patch filessee patches →
    91 added8 removed3 replaced
  15. 15
    supabase108.9 fixes / 100 ops
    184 fixes169 operations3 patch filessee patches →
    184 added
  16. 16
    npm103.0 fixes / 100 ops
    34 fixes33 operations11 patch filessee patches →
    30 removed3 added1 replaced
  17. 17
    surrealdb87.5 fixes / 100 ops
    14 fixes16 operations1 patch filesee patches →
    14 added
  18. 18
    daytona85.1 fixes / 100 ops
    235 fixes276 operations37 patch filessee patches →
    221 added8 removed4 tested2 replaced
  19. 19
    clickhouse-cloud77.3 fixes / 100 ops
    140 fixes181 operations34 patch filessee patches →
    96 added21 replaced17 moved6 removed
  20. 20
    modal68.7 fixes / 100 ops
    200 fixes291 operations32 patch filessee patches →
    200 added
  21. 21
    questrade68.0 fixes / 100 ops
    17 fixes25 operations4 patch filessee patches →
    8 removed5 copied4 moved
  22. 22
    digitalocean64.5 fixes / 100 ops
    596 fixes924 operations42 patch filessee patches →
    549 added24 removed23 replaced
  23. 23
    stripeused in Alchemy52.9 fixes / 100 ops
    343 fixes648 operations5 patch filessee patches →
    341 added2 replaced
  24. 24
    acme50.0 fixes / 100 ops
    6 fixes12 operations3 patch filessee patches →
    4 added1 removed1 replaced
  25. 25
    inngest46.7 fixes / 100 ops
    42 fixes90 operations5 patch filessee patches →
    31 added6 removed5 replaced
  26. 26
    zerossl45.5 fixes / 100 ops
    5 fixes11 operations1 patch filesee patches →
    4 added1 replaced
  27. 27
    forgejo40.9 fixes / 100 ops
    203 fixes496 operations14 patch filessee patches →
    190 added10 replaced3 moved
  28. 28
    e2b38.1 fixes / 100 ops
    37 fixes97 operations11 patch filessee patches →
    37 added
  29. 29
    hydradb35.6 fixes / 100 ops
    16 fixes45 operations5 patch filessee patches →
    16 added
  30. 30
    neonused in Alchemy33.1 fixes / 100 ops
    59 fixes178 operations7 patch filessee patches →
    57 added2 moved
  31. 31
    planetscaleused in Alchemy31.6 fixes / 100 ops
    93 fixes294 operations8 patch filessee patches →
    74 removed17 added2 replaced
  32. 32
    turso30.2 fixes / 100 ops
    16 fixes53 operations4 patch filessee patches →
    16 added
  33. 33
    steel27.8 fixes / 100 ops
    15 fixes54 operations5 patch filessee patches →
    15 added
  34. 34
    prismaused in Alchemy26.1 fixes / 100 ops
    31 fixes119 operations4 patch filessee patches →
    31 added
  35. 35
    awsused in Alchemy25.6 fixes / 100 ops
    5,020 fixes19,631 operations240 patch filessee patches →
    4,781 added155 removed73 copied11 replaced
  36. 36
    clerk23.8 fixes / 100 ops
    76 fixes320 operations4 patch filessee patches →
    76 added
  37. 37
    gcp23.6 fixes / 100 ops
    3,284 fixes13,901 operations129 patch filessee patches →
    3,267 added16 removed1 replaced
  38. 38
    proxmox23.0 fixes / 100 ops
    157 fixes684 operations2 patch filessee patches →
    157 added
  39. 39
    namespacelabs22.0 fixes / 100 ops
    40 fixes182 operations9 patch filessee patches →
    40 added
  40. 40
    netbird16.0 fixes / 100 ops
    37 fixes231 operations3 patch filessee patches →
    37 added
  41. 41
    scaleway12.6 fixes / 100 ops
    199 fixes1,580 operations36 patch filessee patches →
    130 added35 replaced34 copied
  42. 42
    starburst-galaxy11.2 fixes / 100 ops
    23 fixes205 operations6 patch filessee patches →
    18 added4 removed1 replaced
  43. 43
    exa11.1 fixes / 100 ops
    8 fixes72 operations2 patch filessee patches →
    8 added
  44. 44
    anthropic10.7 fixes / 100 ops
    40 fixes374 operations16 patch filessee patches →
    32 added6 replaced2 removed
  45. 45
    azure8.5 fixes / 100 ops
    1,175 fixes13,887 operations60 patch filessee patches →
    1,061 replaced96 added14 removed4 moved
  46. 46
    mux8.5 fixes / 100 ops
    12 fixes142 operations3 patch filessee patches →
    12 added
  47. 47
    hetznerused in Alchemy6.2 fixes / 100 ops
    11 fixes178 operations5 patch filessee patches →
    10 added1 replaced
  48. 48
    entire4.0 fixes / 100 ops
    21 fixes520 operations7 patch filessee patches →
    20 added1 removed
  49. 49
    typesense3.8 fixes / 100 ops
    3 fixes79 operations1 patch filesee patches →
    3 added
  50. 50
    discord3.6 fixes / 100 ops
    9 fixes250 operations2 patch filessee patches →
    6 added3 replaced
  51. 51
    boxd3.1 fixes / 100 ops
    4 fixes131 operations2 patch filessee patches →
    2 removed2 added
  52. 52
    onepassword3.0 fixes / 100 ops
    1 fixes33 operations1 patch filesee patches →
    1 added
  53. 53
    opensearch3.0 fixes / 100 ops
    19 fixes635 operations5 patch filessee patches →
    19 added
  54. 54
    vercel2.3 fixes / 100 ops
    11 fixes476 operations2 patch filessee patches →
    11 added
  55. 55
    polymarket1.8 fixes / 100 ops
    4 fixes223 operations2 patch filessee patches →
    3 added1 replaced
  56. 56
    meilisearch1.4 fixes / 100 ops
    2 fixes143 operations1 patch filesee patches →
    1 moved1 replaced
  57. 57
    github1.0 fixes / 100 ops
    12 fixes1,235 operations5 patch filessee patches →
    10 added1 replaced1 removed
  58. 58
    coinflow1.0 fixes / 100 ops
    2 fixes207 operations2 patch filessee patches →
    2 added

Not yet exercised

Zero patches, zero evidence.

56 providers have no patches, but no consumer has leaned on them yet. A clean sheet here means untested, not correct — they move up once something real depends on them.

Method — how this is counted

  • A fix is one JSON Patch operation (add, replace, remove, move, …) in a file under packages/<provider>/patches/. For AWS, whose patches are declarative, each named operation, structure or error entry counts as one.
  • An operation is one generated SDK call — an exported OperationMethod in src/services/.
  • Patches are how an SDK is kept correct without editing generated code; they survive regeneration. A high count says something about the spec, not the provider's API.
  • Used in Alchemy means an Alchemy resource imports the package on main — read from Alchemy's package.json at build time (checked 2026-09-17, cached). Zero patches on a package nobody consumes is not counted as clean.
  • Think a count is wrong? Open an issue in alchemy-run/distilled. When a provider fixes its spec upstream, the patch goes away.