Resolved
This incident has been resolved.
Monitoring
A fix has been fully deployed and fine-tuned snapshots can be sampled from normally again. Impacted fine-tunes were those created after 3:48pm PT on 9/23.
Identified
A fix is being deployed, 404 errors should subside before 9:30pm PT.
Investigating
Issue has been identified and reproduced internally, we are preparing a fix.
Investigating
We are continuing to investigate this issue. It appears to impact some fine-tuned models created after 4:10pm PT today (9/23)
Investigating
We are investigating reports that sampling requests to fine-tuned models are returning 404 due to lack of sampling permissions.
