Dear Friends — we are proud to announce the program of Scale By the Bay 2018, our sixth year of the flagship, and by now iconic, independent developer conference By the Bay. (Tl;dr: get your spot at http://scale.bythebay.io while supplies last, and especially when Early Bird is in effect until August 31.)
We have great GraphQL talks at scale.bythebay.io, held at Twitter in November! Check out
https://sched.co/FmES Transpiling GraphQL instead of writing customized server code -- Twitter Engineering
https://sched.co/FmEh 2 Fast 2 Furious: migrating Medium's architecture without slowing down -- Medium Engineering
https://sched.co/FmFC Edit Speaker Tools Graph-First Services Using GraphQL -- Twitter
https://sched.co/FmF9 Edit Speaker Tools Orchestrating Microservices with GraphQL -- Ituit
These talks link with many others showing full-stack architectures, microservices, legacy updates, and data pipelines. The conference is the best full stack in a box developer experience that goes all the way from devops to AI as done by engineers, who need results.
The conference follows the established three-day, three track structure, hosted for the third year in a row by Twitter HQ in its wonderful modern building, with all of its spacious tracks, community spaces, cozy booths, and the commons area where so many connections are made during the hallway track.
This year, Martin Odersky, the creator of Scala, opens the main conference on November 15. Neha Narkhede, the co-creator of Kafka and cofounder of Confluent, is keynoting the day 2.
The three tracks are
— Functional and Thoughtful Programming
— Reactive Microservices and Streaming Architectures
— End-to-end Data Pipelines all the way up to Machine Learning and AI
The 100 sessions include technology leaders such as Twitter, IBM, Microsoft, Salesforce, Fauna, DataStax, Databricks, Confluent, Credit Karma, Sumo Logic, GoPro, Buoyant, Workday, Zignal Labs, and many more. We cover your tools with JetBrains, your shopping with Best Buy and Target, your vacations with HomeAway, your listening with Spotify, your viewing with Netflix, your reading with Medium, and your banking with JP Morgan Chase. The list goes on and on and on — we have the most of the advanced stacks and approaches employed by the best that Silicon Valley offers to the world at scale, shared as best practices, with code, yours to learn, take home, and build upon.
Our speakers span the whole spectrum from the first-time presenters with leading companies to veterans of SBTB going all the way back to 2013, evolving their craft before our eyes. You can follow their progress by watching their previous talks on http://functional.tv and the photos of the past conferences at
The three panels, closing each day, are:
— Thoughtful Software Engineering
— Data Engineering for AI, and
— Cloud, Edge, and Silver Lining.
Each day begins with a hot breakfast, that begins an uninterruptible supply of Philz coffee through the whole day, and lunch is provided. On the first two days, the closing panels are followed by our signature happy hours, with great drinks, food, and conversation. The hallway tracks are legendary.
SBTB is famous for its bespoke, all-day, build-yourself-a-company training. This year, we double it. Cliff Click, the legend of software engineering, is teaching a full day Advanced Software Engineering workshop on 11/13, followed by Ryan Knight, now of Fauna, leading cloud-native data pipelines on 11/14. The workshops are limited by 80 participants each.
As last year, we’ll plan an unconference track for those who want to share their ideas in an intimate setting for joint brainstorming.
We are always sold out by the time the conference begins in November — so reserve your seat early at http://scale.bythebay.io!
Due to the overwhelming clamor for late submissions and great talks coming in still, the CFP is logarithmically extended as follows.
1/2 the program will be formed with the submissions added by 5/31.
The next quarter will take into account those sent by 6/15 and the rest of the submissions that didn’t make the cut yet.
The next part will be selected from all those plus the talks submitted by 6/30.
A block of time is reserved for the invited talks of exceptionally high quality and importance, expanding the scope of the conference.
Submit your talk at scale.bythebay.io!
It's the sixth year that we are organizing our flagship Scale By the Bay conference, and it's a truly spectacular tech event many of you know very well. For those who are new to SBTB, I would love to invite you to attend. And if you'd like to present, we'd like to see your talk!
The CFP for SBTB 2018 is now open through May 31:
Give it your best shot, or two, as the rate of high-quality submissions is already very high.
At Scale By The Bay, returning to Twitter HQ in San Francisco on November 15-17, 2018, you can connect with fellow senior software engineers, CTOs, VPs/Directors of Engineering, developers and technical founders who never stop learning. Embrace the whole end-to-end software stacks and infrastructure running them, put together your own SMACK Stack, operationalize reactive micro services and data pipelines, build streaming data infrastructure for actionable, real-time insights, and deep-dive into practical aspects of full-stack architectures and developer productivity.
We'll have a stellar program:
* the full-stack Scala and Functional Programming conference with world authorities on practical FP, beginning with Martin Odersky, the creator of Scala, who comes back to keynote SBTB!
* the fast data pipelines done right, with Neha Narkhede, the co-creator of Apache Kafka and co-founder of Confluent, keynoting
* FP+ML: Functional Programming for Machine Learning, a topic even more current today when TensorFlow for Swift has been unveiled
Throughout the three track, three day event, we'll weave the themes of open-source development, type safety, full-stack acrhitectures, with the emerging areas of ML and AI so that you can learn all about it if you want to. At the same time, we'll make sure we're still, and always, the best in the software engineering realm with solid understanding of distributed systems, from operations up to services to streaming algorithms.
We firmly believe that thoughtful software engineering with the right reusable abstractions and best practices around development is key to everything. We want to link this approach to more things and see more use cases. We especially welcome FP+ML talks this year.
Please note that we go forward at Scale. We welcome production use cases of all thoughtfully designed software stacks, including Scala, Haskell, Swift, Rust, Clojure, F#, and so on. We welcome Java, C++, Go, and other systems, especially in the microservice, polyglot environment.
Our SMACK 2.0 plan, unveiled at the Index conference, calls for Streaming, in-Memory architectures, API-centric, Containerized and running on Kubernetes. We welcome submissions on all levels of these new systems, starting with orchestration.
No matter where you are along the full-stack spectrum, you need thoughtful software engineering, reactive and streaming architectures, manageable micro services, and scalable data pipelines that can work together with modern ML frameworks for immediate customer insights. Join the SBTB family at Twitter HQ again this year, see how companies like Twitter are built in software, build your own, and share your findings with others!
See you in November at Twitter HQ!
Dr. Alexy Khrabrov, Program Chair, By the Bay
PS. If you are in Europe and can't wait, By the Bay comes to Amsterdam as RethinkTrust.org, out first signature engineering take on enterprise trust systems with blockchain and hyperledger in energy, fintech, IoT, and other real-world use cases. Our tech includes Swift and Scala, scalability and security of trust systems, their performance and enterprise stacks integration — the topics rarely, if ever, covered at general blockchain events. Use the code TRUSTBYTHEBAY for 15% off and join us in Amsterdam!
IBM Index (http://chief.sc/index-2018) is a fantastic new developer conference. Register (http://chief.sc/index-2018-register) by 2/20 with the code CD3ALEXY to attend the Community Day for free and the main program for just $280.
SMACK 2.0 panel (http://chief.sc/index-2018-smack20-panel) is held on 2/22 at 2pm, preceded by the SMACK 2.0 workshop (http://chief.sc/iindex-2018-smack20-workshop) on the community day (day 0, 2/20, 3-5:30pm).
In this panel, we discuss SMACK (http://smackstack.org/), the popular framework to describe and compare data pipelines. SMACK 1.0 was often composed of Spark, Mesos, Akka, Cassandra and Kafka. In SMACK 2.0, we explore emerging ways to build scalable data-heavy applications for Machine Learning, relying on Streaming, and in-Memory computing (including Spark), Model-serving, API, Cloud/Cassandra/Containers and Kubernetes (with Kafka often being the source). Instead of fixing SMACK components as we did for SMACK 1.0 — Data source, API, Compute, Persistence, Operationalization — we consider alternatives for various use cases. For instance, S will increasingly be Serverless. What are the emerging patterns, and when some of the approaches make more sense than others? Certain applications, such as Fintech, inform in-Memory computing, while others, such as IoT, favor streaming with real-time AI feedback.
Nikita Ivanov, co-founder and CTO, GridGain
Sijie Guo, co-founder, Streamlio
Anya Bida, DevOps Engineer, Salesforce
Hugh McKee, Developer Advocate, Lightbend
Tathagata Das, Software Engineer, Databricks
The SMACK 2.0 panel is preceded by the workshop (http://chief.sc/iindex-2018-smack20-workshop) during the Community Day.
Both sessions are curated and moderated by Dr. Alexy Khrabrov (http://chiefscientist.org/), the founder and organizer of Scale By the Bay and the creator of the original SMACK Stack (http://smackstack.org/) training.
We're happy to announce two new Index (http://chief.sc/index-2018) sessions. 2/20 is the free SMACK 2.0 workshop. Moscone West, 3-5:30pm. Register (http://chief.sc/index-2018-register) by 2/20 with the code CD3ALEXY to attend the Community Day for free and the main program for just $280.
(1) Streaming -- Streamlio
(2) Memory computing -- GridGain
(1) Building modern data pipelines by unifying Apache Pulsar, Apache Heron, Apache BookKeeper
For today’s enterprises, ensuring that data pipelines are available to every corner of the organization is key to building next generation data-driven applications. In this talk Karthik Ramasamy of Streamlio will present on how to combine three best of breed open-source projects to have a solid data infrastructure that are is easy to develop against and simple to operate at scale in production.
He will provide an overview of the merits of the three open source systems and then benefits they bring when integrated:
Apache Pulsar: unified queuing and streaming
Apache Heron: stream processing
Apache BookKeeper: distributed stream storage
Karthik Ramasamy is the co-founder of Streamlio that focuses on building next generation real time processing engines. Before Streamlio, he was the engineering manager and technical lead for real-time analytics at Twitter where he co-created Twitter Heron. He has two decades of experience working in parallel databases, big data infrastructure, and networking. Karthik is the author of several publications, patents, and "Network Routing: Algorithms, Protocols and Architectures". He has a Ph.D. in computer science from the University of Wisconsin, Madison with a focus on big data and databases.
(2) Apache Spark and Apache Ignite: Where Fast Data Meets the IoT
It is not enough to build a mesh of sensors or embedded devices to obtain more insights about the surrounding environment and optimize your production systems. Usually, your IoT solution needs to be capable of transferring enormous amounts of data to storage or the cloud where the data have to be processed further. Quite often, the processing of the endless streams of data has to be done in real-time so that you can react on the IoT subsystem's state accordingly.
This session will show attendees how to build a Fast Data solution that will receive endless streams from the IoT side and will be capable of processing the streams in real-time using Apache Ignite's cluster resources.
In particular, attendees will learn about data streaming to an Apache Ignite cluster from embedded devices and real-time data processing with Apache Spark.
(3) Building Your First Spark & Cassandra Application: A Code-Along Adventure w/ Russell Spitzer
Not sure where to start with Cassandra and Spark? Together let’s walk through starting your first Spark Application. We’ll walk through the setting up your IDE and integration tests, everything you need to build your first scalable and distributed Spark App. Learn how to use embedded Cassandra and Spark to write your own tests which are easily debuggable in standard IDEs. This will be a short but interactive adventure! Feel free to bring your own laptop and come code along!
We will be using IDEA along with the template provided by Datastax
About Russell Spitzer: After earning his Ph.D in bioinformatics from UCSF, Russell Spitzer took his love of big data to DataStax. There he has worked on all aspects of integrating Cassandra with other Apache technologies like Spark, Hadoop and Solr. Now his main focus on the integration of Cassandra with Apache Spark via the Spark Cassandra Connector.
We are working with the IBM community teams to make their flagship developer conference, Index ( http://www.indexconf.com/ ), the most meaningful and fun experience for Bay Area developers.
Alexy Khrabrov talks about Index with Markus Eisele, Selection Committee Chair and Director of Developer Advocacy, Lightbend: http://chief.sc/index-2018-overview
In our communities, we created and popularized the
SMACK Stack ( http://smackstack.org/ )
-- a way to reason about end-to-end data pipeline architectures. Building and running such pipelines, and the components comprising them, are the key themes of Index. The conference starts with the free
Index Community Day ( https://developer.ibm.com/indexconf/communities/ ), 2/20
which consists of 14 half-day sessions on the key technologies, many either directly relevant or of strong interest to most of us:
• Cloud Foundry
You can build multiple viable architecture from these technologies, and they are often used together. To explore the progress made since SMACK 1.0, introduced in 2015, we are putting together a SMACK 2.0 panel, brainstorming the emerging SMACK Stacks.
There is a wealth of expertise from many of the companies that present By the Bay regularly: Google (TensorFlow), Lightbend, Twilio, Slack, Uber, Google, Facebook, IBM, Eero, Spotify and many others.
You can already meet many speakers at the IBM developerWorks TV playlist for Index:
We’ll update this description as we ramp up our Index + SMACK 2.0 events!
Scala-JS just hit 1.0.0 and React-native is maturing well. Combining the advantages of both yields the promise of end-to-end FP to generate 3 different apps from a single code base. Add to the mix GraphQL in a server-less configuration and we have a real shot at building a meaningful app in a meetup.
Irfan Ahmad is a full-stack founder of two Silicon Valley startups. He loves new code smell and started developing with Scala back before it was cool. Prior to this, Irfan was at VMware hacking on hypervisors and at Transmeta working on the Crusoe software microprocessor. Irfan is an inventor on more than thirty patents, has published at ACM SOCC, USENIX FAST, ATC and IEEE IISWC and has chaired HotStorage, HotCloud and VMware’s R&D Innovation Conference. Irfan serves on steering committees for USENIX HotStorage and HotCloud. Irfan earned his pink tie from the University of Waterloo.
Taimur Mirza is a senior software engineer from Automation Anywhere and has more than 15 years of experience in building distributed applications with open source technologies. He worked at Qumu, BabyCenter and DeviceAnywhere in the past.
Coursera is the leading online education company in the world. Its backend is Scala, and they evolved multiple ideas of the API to serve its thousands of courses with multiple ontologies, authors, students, etc.
Coursera embraced GraphQL and uses Sangria, the excellent Open-Source implementation of GraphQL for Scala. Brennan Saeta, the Software Architect at Coursera, has presented it at the first GraphQL Summit. At this meetup, we'll explore what GraphQL is and how it will supercede REST. GitHub bet their future of the GraphQL API.