Roman Shaposhnik

Hadoop has been touted as a replacement for data warehouses. In practice Hadoop has had success offloading ETL/ELT workloads, but still has gaps serving requirements for operational analytics.

Apache Bigtop now includes Greenplum Database in deployment of big data solutions. Greenplum Database is, an open source massively parallel data warehouse based on PostgreSQL, and is an excellent addition to the Hadoop ecosystem.

In this session we'll cover: * Introduction to Greenplum * Bigtop Support for Greenplum * External tables in Hadoop by Greenplum * Parallel reads and writes to Hadoop by Greenplum * Running advanced analytics on structured and unstructured data in both Hadoop and Greenplum via Apache MADlib (incubating) * Geospatial and Machine Learning in Greenplum based on HDFS data * Storing data from a data lake in Greenplum for high throughput analytical queries

Scylla is a new NoSQL database, capable of 2 million requests per second per node, while providing Apache Cassandra compatibility and scaling properties. Scylla applies systems programming techniques to a horizontally scalable NoSQL design to achieve extreme performance improvements. As CPU core counts continue to grow, along with the raw speed of networking and storage devices available on a modern system, software design approaches that were valid and safe even a few years ago are no longer sustainable.

Scylla enables high throughput, low latency, and rapid completion of housekeeping operations such as compaction. Scylla eliminates known performance bottlenecks of existing NoSQL servers by running multiple engines, one per core, each with its own memory, CPU and multi-queue NIC. Scylla bypasses key performance bottlenecks that can affect NoSQL server performance using per-core memory allocation to avoid locking, and asynchronous I/O for storage to bypass the system page cache. With Scylla, NoSQL projects can avoid performance uncertainties up front in order to deploy a system that performs and scales with a low risk of unpredictable performance issues later.