GraphFrames: DataFrame-based graphs for Apache Spark - Seguridad Mania.com - España y América Latina

GraphFrames bring the power of Apache Spark DataFrames to interactive analytics on graphs. Expressive motif queries simplify pattern search in graphs, and DataFrame integration allows seamlessly mixing graph queries with Spark SQL and ML. By leveraging Catalyst and Tungsten, GraphFrames provide scalability and performance. Uniform language APIs expose the full functionality of GraphX to Java and Python users for the first time. In this talk, the developers of the GraphFrames package will give an overview, a live demo, and a discussion of design decisions and future plans. This talk will be generally accessible, covering major improvements from GraphX and providing resources for getting started. A running example of analyzing flight delays will be used to explain the range of GraphFrame functionality: simple SQL and graph queries, motif finding, and powerful graph algorithms. For experts, this talk will also include a few technical details on design decisions, the current implementation, and ongoing work on speed and performance optimizations.