On the 29th of September through the 1st of October 2015, QA Consulting sponsored and attended the Strata + Hadoop World event in New York City.
The NYC Strata + Hadoop is one of the largest Big Data events of the year, with attendance numbers reaching over 5,500, as well as 135 exhibitors! Strata + Hadoop provided a unique opportunity for our QA Consulting team to discover new ideas, advanced and improved practices and discover some of the most recent techniques used within the Big Data world.
The event started on Wednesday with tutorial sessions that drew a big crowd with over a dozen on offer and many whole-day workshops. Sessions included a full day Spark camp, which was introduced this year and reflected the momentum Spark has gained over the last year. In addition, Python and D3.js continued to have a strong representation.
Our partner, Cloudera, discussed the trade-offs between real-time transactional access and fast analytic performance in Hadoop, from the perspective of storage engine internals. Also discussed was recent advances, evaluate benchmark results from current generation Hadoop technologies, and propose potential ways ahead for the Hadoop ecosystem to conquer its newest set of challenges.
Next up, HowOld.net, the robot that reached an extreme 50 million users in just one week. To handle this massive amount of users unexpectedly, HowOld robot needed elasticity, built in monitoring, and cloud technology to control and sustain the rapid progression. Their cloud technology turned hardware into software, software into services, and data into intelligence, providing them with the agility needed in today’s online world.
We then had Joy Johnson who elaborated the importance of technology within the vastly growing online music industry. The recent convergence of digital music, streaming services, and big data have created a new discipline, Music Science. This has allowed digital downloads and monthly subscriptions to replace all physical distributions of music, leaving labels scrambling and artists adapting to a new world of technology.
The keynote continued on the topic of creativity with the BBC Worldwide insight team lead, David Boyle, his section focussed on the comparisons on data vs. creativity. He discussed the growing importance on data science, and how it’s growth is allowing it to play a bigger role in creative industries. By recognition of the industry being about the people and helping them by providing data to help influence and make decisions, allowing data to be at the heart of the creative process.
Concluding day 1’s keynote, Dr. Dj Patil, White House office of Science and Technology Policy. Dr. DJ Patil discussed the act of responsibly unleashing the power of data for the benefit of the American public and maximization to the nations return on its investment in data. His overall goal being to make the power of data available and easily usable for all Americans and essentially the world.
Kicking Day 2 off was Paul Kent, VP of Big Data initiatives at SAS. Kent provided significant tips from the future (provided by Big Data) as well as key patterns emerging from a wide cross section of corporate and institutional Hadoop journeys. The ideas of having all your data in one place, at a reasonable cost, with computing potential to learn from relations between data in all domains.
Keynote speaker and New Yorker Mastermind, Maria Kornikova dives into the importance of time management and recapturing the seeming nothingness of boredom. She emphasises the vital details of harnessing life breaks for capturing ultimate creative potential in the workforce.
Finally we observed the talks of Jack Norris and his emphasis on how companies can get the biggest results from their data projects today through apps. Examples of apps used by leading companies in providing the insights for developers and organisations for realising big data dividends of scalable applications.
Strata + Hadoop’s deep-immersion event allowed data scientists, analysts, and executives to get up to speed on emerging techniques and technologies by dissecting case studies, developing new skills through tutorials, and share emerging best practices in data science, and imagining the future of technology. Overall this was a great event for QA Consulting to introduce ourselves formally to the Big Data space.