I Trained Mistral on the US Army’s Field Manuals. The Model (and its new 2.3-million-token instruct dataset) are Open Source!

I really enjoy making niche domain experts. I've made and posted about a few before , but I was getting a bit sick of training on Gutenberg. So I went digging for openly-published texts on interesting subjects, and it turns out the US Military publishes a lot of stuff and it's a bit more up-to-date than the 18th-century manuals I used before . So I made a model... this model, the training data, and the datagen configs and model training config, are all open source.