Simple AI Token Profiler / Debugger

1 points | by TreDub an hour ago

1 comments

  • TreDub an hour ago

    We made a simple profiler to help optimize AI token spend. Generally speaking anytime you want to optimize your app, whether it's for memory or otherwise you typically start with a profiler. There are a ton of MiTM Gateways but there aren't many true profilers, so I thought I'd make one. Just sign up, create a "system", instrument it, and watch. Great way to see where your tokens are going.