Takeoff Roadmap

These docs are outdated! Please check out https://docs.titanml.co/docs/category/titan-takeoff for the latest information on the Titan Takeoff server. If there's anything that's not covered there, please contact us on our discord.

We are always working on ways to improve the Takeoff server. Here is a rough list of things that we are working on completing in the near future. This list is neither in chronological nor importance order, but if something isn't on the list then it is not a priority for now.

If there is something you think we should be focused on send us a message by email at [e-mail] with the subject as 'Takeoff' or join the Discord.

• Reduced conversion memory overhead

• 4bit support

• Accelerated cpu builds with math acceleration libraries (MKL, oneDNN, etc)

• Improved large batch performance with vLLM

• Improved decoding methods

• Chat interface front-end