2 comments

  • tolugenius 10 minutes ago

    > To improve determinism, define a system instruction with explicit rules for your specific use case.

    Is this guaranteed to work any better than top_k or top_p? This just sounds like making a smaller version of a Agent.md doc.

  • greatgib 2 hours ago

    1. Sampling parameter deprecation (temperature, top_p, top_k)

    temperature, top_p, and top_k are deprecated and ignored. In future model generations, supplying these parameters returns an HTTP 400 error. Remove these parameters from all requests.