Bigtop is an Apache Foundation project for Infrastructure Engineers and Data Scientists looking for comprehensive packaging, testing, and configuration of the leading open source big data components.
Insights into bootstrapping and automation of the packaging process on ci.bigtop.apache.org will be given. Special focus is on the use of docker containers for isolating and scaling the build processes.
Some aspects of the challenges of porting the bigtop distribution to other platforms will be covered, too.
Another focus of the talk will be on deploying Bigtop components using the supplied puppet scripts.
Included are life deployment demos into docker containers featuring different Big Data scenarios.
REPLACEMENT for "Building open source with open source" by Nicolas Schiper