Ibis is a new Python data analysis framework with the goal of enabling data scientists and data engineers to be as productive working with big data as they are working with small and medium data today. In doing so, we will enable Python to become a true first-class language for Apache Hadoop, without compromises in functionality, usability, or performance. Having spent much of the last decade improving the usability of the single-node Python experience (with pandas and other projects), we are looking to achieve:
100% Python end-to-end user workflows
Native hardware speeds for a broad set of use cases
Full-fidelity data analysis without extractions or sampling
Scalability for big data
Integration with the existing Python data ecosystem (pandas, scikit-learn, NumPy, and so on)
