clearml/README.md

116 lines
5.1 KiB
Markdown
Raw Normal View History

2019-06-10 20:24:57 +00:00
# TRAINS
2019-06-13 22:07:02 +00:00
## Auto-Magical Experiment Manager & Version Control for AI
2019-06-10 17:00:28 +00:00
2019-07-08 20:29:09 +00:00
"Because its a jungle out there"
2019-06-10 17:00:28 +00:00
2019-06-11 15:11:28 +00:00
[![GitHub license](https://img.shields.io/github/license/allegroai/trains.svg)](https://img.shields.io/github/license/allegroai/trains.svg)
2019-06-11 11:36:36 +00:00
[![PyPI pyversions](https://img.shields.io/pypi/pyversions/trains.svg)](https://img.shields.io/pypi/pyversions/trains.svg)
[![PyPI version shields.io](https://img.shields.io/pypi/v/trains.svg)](https://img.shields.io/pypi/v/trains.svg)
[![PyPI status](https://img.shields.io/pypi/status/trains.svg)](https://pypi.python.org/pypi/trains/)
2019-07-08 20:29:09 +00:00
TRAINS is our solution to a problem we share with countless other researchers and developers in the machine
learning/deep learning universe: Training production-grade deep learning models is a glorious but messy process.
TRAINS tracks and controls the process by associating code version control, research projects,
performance metrics, and model provenance.
2019-06-10 17:00:28 +00:00
2019-06-13 22:08:08 +00:00
We designed TRAINS specifically to require effortless integration so that teams can preserve their existing methods
and practices. Use it on a daily basis to boost collaboration and visibility, or use it to automatically collect
2019-06-13 22:07:02 +00:00
your experimentation logs, outputs, and data to one centralized server.
2019-06-10 17:00:28 +00:00
2019-07-08 20:29:09 +00:00
(Experience TRAINS live at [https://demoapp.trainsai.io](https://demoapp.trainsai.io))
2019-06-11 12:16:20 +00:00
![Alt Text](https://github.com/allegroai/trains/blob/master/docs/webapp_screenshots.gif?raw=true)
2019-06-10 17:00:28 +00:00
## Main Features
2019-07-08 20:29:09 +00:00
* Seamless integration with leading frameworks, including: *PyTorch*, *TensorFlow*, *Keras*, and others coming soon
* Support for *Jupyter Notebook* and *PyCharm* remote debugging
* Automatic log collection.
* Query, Filter, and Compare your experiment data and results
2019-06-13 22:07:02 +00:00
* Share and collaborate
2019-07-08 20:29:09 +00:00
**Detailed overview of TRAINS offering and system design can be found [Here](https://github.com/allegroai/trains/blob/master/docs/brief.md).**
## Using TRAINS
2019-06-10 17:00:28 +00:00
2019-06-13 22:08:08 +00:00
We have a demo server up and running at https://demoapp.trainsai.io. You can try out TRAINS and test your code with it.
2019-06-13 22:07:02 +00:00
Note that it resets every 24 hours and all of the data is deleted.
2019-06-11 12:10:16 +00:00
2019-07-08 20:29:09 +00:00
When you are ready to use your own TRAINS server, go ahead and [install *TRAINS-server*](#configuring-your-own-trains).
TRAINS requires only two lines of code for full integration.
To connect your code with TRAINS:
2019-06-10 17:00:28 +00:00
1. Install TRAINS
pip install trains
2019-07-08 20:29:09 +00:00
2. Add the following lines to your code
2019-06-10 17:00:28 +00:00
from trains import Task
2019-06-18 15:26:38 +00:00
task = Task.init(project_name="my project", task_name="my task")
2019-06-10 17:00:28 +00:00
2019-07-08 20:29:09 +00:00
* If project_name is not provided, the repository name will be used instead
* If task_name (experiment) is not provided, the current filename will be used instead
3. Run your code. When TRAINS connects to the server, a link is printed. For example
2019-06-11 12:10:16 +00:00
2019-06-13 22:07:02 +00:00
TRAINS Results page:
2019-06-11 12:10:16 +00:00
https://demoapp.trainsai.io/projects/76e5e2d45e914f52880621fe64601e85/experiments/241f06ae0f5c4b27b8ce8b64890ce152/output/log
2019-06-10 17:00:28 +00:00
2019-07-08 20:29:09 +00:00
4. Open the link and view your experiment parameters, model and tensorboard metrics
2019-06-10 17:00:28 +00:00
2019-07-08 20:29:09 +00:00
## Configuring Your Own TRAINS
2019-06-13 22:07:02 +00:00
2019-07-08 20:29:09 +00:00
1. Install and run *TRAINS-server* (see [Installing the TRAINS Server](https://github.com/allegroai/trains-server))
2019-06-13 22:07:02 +00:00
2019-07-08 20:29:09 +00:00
2. Run the initial configuration wizard for your TRAINS installation and follow the instructions to setup TRAINS package
(http://**_trains-server-ip_**:__port__ and user credentials)
2019-06-10 17:00:28 +00:00
trains-init
2019-06-13 22:27:25 +00:00
After installing and configuring, you can access your configuration file at `~/trains.conf`
Sample configuration file available [here](https://github.com/allegroai/trains/blob/master/docs/trains.conf).
2019-06-10 17:00:28 +00:00
2019-06-13 22:27:25 +00:00
*For more examples and use cases*, see [examples](https://github.com/allegroai/trains/blob/master/docs/trains_examples.md).
2019-07-08 20:29:09 +00:00
## Who We Are
2019-06-10 17:00:28 +00:00
2019-06-13 22:08:08 +00:00
TRAINS is supported by the same team behind *allegro.ai*,
2019-06-13 22:07:02 +00:00
where we build deep learning pipelines and infrastructure for enterprise companies.
2019-06-13 22:08:08 +00:00
We built TRAINS to track and control the glorious but messy process of training production-grade deep learning models.
We are committed to vigorously supporting and expanding the capabilities of TRAINS.
2019-06-10 17:00:28 +00:00
## Why Are We Releasing TRAINS?
2019-06-13 22:08:08 +00:00
We believe TRAINS is ground-breaking. We wish to establish new standards of experiment management in
2019-06-13 22:07:02 +00:00
deep-learning and ML. Only the greater community can help us do that.
2019-06-10 17:00:28 +00:00
2019-06-13 22:08:08 +00:00
We promise to always be backwardly compatible. If you start working with TRAINS today,
2019-06-13 22:07:02 +00:00
even though this project is currently in the beta stage, your logs and data will always upgrade with you.
2019-06-10 17:00:28 +00:00
## License
Apache License, Version 2.0 (see the [LICENSE](https://www.apache.org/licenses/LICENSE-2.0.html) for more information)
2019-07-08 20:29:09 +00:00
## Community
2019-06-10 17:00:28 +00:00
2019-07-08 20:29:09 +00:00
If you have any questions, look to the TRAINS [FAQ](https://github.com/allegroai/trains/blob/master/docs/faq.md), or
tag your questions on [stackoverflow](https://stackoverflow.com/questions/tagged/trains) with the 'trains' tag.
2019-06-10 17:00:28 +00:00
2019-07-08 20:29:09 +00:00
For feature requests or bug reports, please use [GitHub issues](https://github.com/allegroai/trains/issues).
Additionally, you can always find us at support@allegro.ai.
## Contributing
See the TRAINS [Guidelines for Contributing](https://github.com/allegroai/trains/blob/master/docs/contributing.md).
2019-06-10 17:00:28 +00:00
2019-07-08 20:29:09 +00:00
_May the force (and the goddess of learning rates) be with you!_
2019-06-10 17:00:28 +00:00