allegro.tech meeting v8

allegro.tech meeting

September 14th, 2015

PGE National Stadium in Warsaw

allegro.tech

allegro.tech is a brand created by the best engineers in allegro to show the community who we are and what we do every day.

ATM

allegro.tech meeting a.k.a. ATM, is an annual meeting of allegro's engineers held to share knowledge about projects that we run, problems that we face and unique solutions that we implement. This is an opportunity to catch up with all the new things that happened to be difficult to communicate due to our location in various cities across Poland. ATM breaks this barrier.

For and by IT” is the leitmotif of the event that has accompanied our efforts since the beginning, that is since 2009. This is when the concept of the conference was proposed by Marcin “Mazek” Mazurek, main coordinator of the first editions.

This two day event is organized in whole by allegro engineers.

allegro.tech meeting v8

It is our intention to have the meeting held interchangeably in one of five locations of our operations: Poznań, Warsaw, Toruń, Kraków and Wrocław. This year’s eighth edition of ATM will take place in Warsaw, on September 14th-15th. We invite our engineers to spend two days in the extraordinary surroundings of the PGE National Stadium and give them the opportunity to listen to the presentations, lightning talks of work mates and to participate in workshops.

A new element this year is that we invite guests from outside Allegro to join us on the first day. We want to share with you everything that we find most valuable, that is the knowledge and experience of our engineers.

Please note that this year's edition is invitation only. In following days we will be inviting industry leaders to join on us on 14th of September.

Date:
September 14th, 2015
Venue:
PGE National Stadium in Warsaw
Address:
PGE National Stadium in Warsaw at Al. Ks. J. Poniatowskiego 1. Main entrance (gate 2, A entrance) – follow information signs and look for Delorean :) (Google Maps)

How to get there?

Fot. PGE National Stadium in Warsaw

Schedule

  1. -

    Registration

  2. -

    First day opening

  3. -

    How to stay innovative 2.0

    Wojciech Burkot (CTO)
  4. -

    Tactical Mesos: How Internet-Scale Ad Bidding Works on Mesos / Aurora

    Dobromir Montauk (Twitter)
  5. -

    Building distributed systems with OSS

    Mateusz Gajewski
    In this presentation I will showcase some of the open source technologies on the market that can be used to built massively scalable distributed systems.
  6. -

    Coffee break

  7. -

    Allegro - Data Center of the 21st century

    Mateusz Wojtowicz
    During the presentation we will answer these questions:
    1. What is a Data Center and what is going on inside it
    2. What is the structure of Allegro Group
    3. What does an online Data Center of Allegro Group look like and some figures about our DC
    4. What technologies we use
    5. What systems we use to manage the Data Centers
    6. Key elements of Data Center protection
    7. Who is the Data Center Operation section
  8. -

    API first! Methodology, techniques and tools for creating good API.

    Przemysław Wyrobek
    Designing a coherent and good REST API is a hard and annoying stage of developing microservices and building the new API for Allegro Platform especially when it has to pass the "API Review" ;). We can do it better and without frustration. In the talk we will focus on design & prototyping a good API. I will talk about techniques and tools that support fast and flexible design (modeling) and testing RESTful APIs.
  9. -

    Machine learning - it's easy!

    Mariusz Strzelecki
    Forecasting future has never been as easy as today. Nowadays we gather more data than even before and there are plenty of machine learning algorithms implemented that work out of the box. Apache Spark is a perfect example of those. In the presentation we show a live demo on how to build an efficient and accurate model of machine learning that uses our Hadoop infrastructure.
  10. -

    Lunch

  11. -

    Artificial intelligence. Status report.

    Tomasz Jackowiak
    Over one thousand high-profile artificial intelligence experts and researchers have signed an open letter in January this year, that pledges to safely and carefully coordinate progress in the field. Signees include Stephen Hawking, Elon Musk, Demis Cassabas and experts at Google and IBM.

    So where we are currently and what awaits us around the corner?

    Let’s talk about exponential growth (and why we can't get our head around it), second half of the chessboard, technological unemployment, morality of algorithms and the evolution of intelligence.
  12. -

    Hermes loses events.

    Łukasz Drumiński
    Hermes is a fast message broker recently open-sourced by Allegro. During the presentation I will explain when your events may not be delivered and what we have done to minimise this kind of situations. Besides that you will find out what we use to monitor events and how our approach to this subject has changed during last year. After we explain stabilisation issues we will delve into performance. I will answer questions like: how fast is Hermes? How many events/s and at what latency can be handled by a single Hermes instance? You will also hear about our failures and lessons we have learned from them.
  13. -

    Integration testing in age of microservices.

    Adam Dudczak, Ernest Bursa
    Consumer Driven Contract (CDC) testing are usually mentioned as one of the solutions that might be used for testing microservices. We make the assumption that service interaction is based on light contracts and adhering to them assures that service remains interoperable. We will investigate how this approach works in practice by showing some examples of how this change in behaviour is implemented using various tools supporting Consumer Driven Contracts. We will compare the experience of using CDC with a different approach to integration testing, in which with support of some aliitional tooling we are able to test all the changes in production without any side-effect to end-users.
  14. -

    Coffee break

  15. -

    Be a hero of information - collecting messages with Allegro Data Hub

    Paweł Leszczyński, Robert Mroczkowski
    At Allegro we handle thousands of messages per second. These are clickstream (12k msgs/s), application logs (40k msg/s) and events sent between microservices (8k msg/s). We have created coherent, scalable system that delivers them to HDFS and ElasticSearch for further processing. Messages are transferred with low latency and stored in well-known format. At the end of the pipeline transferred data could be easily browsed and processed via many tools and frameworks (Kibana dashboards, Spark jobs, Hive Query Language, Hue web interface, Tableau and SQLDeveloper).
    During the presentation we will describe architecture of our data hub. We will tell you about solutions we have used and problems we have challenged. We will also show how it has evolved over the past years. Finally we will tell few words about plans for the future.
  16. -

    Spark Streaming / Apache Kafka - good parts, bad parts

    Marcin Kuthan
    Apache Spark is a distributed data processing platform. It allows effective implementation of iterative algorithms thus removing one of the constraints of map/reduce paradigm. In this talk I will share my experience with Spark Streaming used to process the stream of Allegro users' activities. I will also answer questions like: how to achieve required level of fault tolerance, is it possible to get exactly-once delivery guarantee, how to ensure reliable processing in face of latency spikes, how to deal with stateful processing, how and what to monitor on the YARN cluster, what configuration parameters are important and what alternative solutions we should consider.
  17. -

    Every millisecond counts

    Adam Dubiel
    Network is always available? Remote call costs nothing? Every distributed systems programmer should be already aware those statements are false. By saying SLA, we usually mean service availability and response time. Response time is not only business code, but also network latency and millions of small things in your application. During this talk I will try to show how to gain an upper hand in the fight against time.
  18. -

    1st day closing

  19. -

    After Party

    After party will take place at Restauracja Kameralna (Foksal 11 street). Entrance will be allowed only with the wristband received during the registration.

Speakers

Media