#DOXLON October 2016 - Mesos Deployment at Schibsted
0 likes•2,208 views
The document discusses the implementation of Mesos at Schibsted, highlighting its role as a fault-tolerant, multi-tenant cluster management system focused on resource management and container execution. It mentions tools like Marathon for container orchestration and Chronos for job scheduling, along with lessons learned from deployment challenges and the comparison of Kubernetes to Mesos. Key points include the importance of using stable frameworks and insights drawn from other companies' experiences.
![CHRONOS FRAMEWORK
UNREGISTERED
...sched.cpp:736] Got error 'Completed framework attempted to re-register'
...sched.cpp:1320] Asked to abort the driver
INFO Error: Completed framework attempted to re-register (com.airbnb.schedule
INFO Shutting down job scheduler (com.airbnb.scheduler.jobs.JobScheduler:661)
...sched.cpp:777] Aborting framework '20150116-150711-4084312256-5050-20769-0
...sched.cpp:1286] Asked to stop the driver
...sched.cpp:752] Stopping framework '20150116-150711-4084312256-5050-20769-0](https://image.slidesharecdn.com/mesos-161101174039/85/DOXLON-October-2016-Mesos-Deployment-at-Schibsted-7-320.jpg)
#DOXLON October 2016 - Mesos Deployment at Schibsted
- 1. MESOS AT SCHIBSTED LEASONS LEARNED Created by Alan Bover / [email protected]
- 2. MESOS 0.27 Fault-tolerant - Multi-tenant cluster management system Mostly Resource management, Container execution and Authorization Two level-scheduling system
- 3. HOW DO WE USE MESOS? Marathon: Container orchestration platform Chronos: Fault tolerant job scheduler In-house developed framework for fraud detection
- 4. ZEUS PROJECT
- 5. STABILITY "With Mesos, your experience will be AS GOOD as the framework you use"
- 6. DON'T TRUST ME, TRUST NETFLIX
- 7. CHRONOS FRAMEWORK UNREGISTERED ...sched.cpp:736] Got error 'Completed framework attempted to re-register' ...sched.cpp:1320] Asked to abort the driver INFO Error: Completed framework attempted to re-register (com.airbnb.schedule INFO Shutting down job scheduler (com.airbnb.scheduler.jobs.JobScheduler:661) ...sched.cpp:777] Aborting framework '20150116-150711-4084312256-5050-20769-0 ...sched.cpp:1286] Asked to stop the driver ...sched.cpp:752] Stopping framework '20150116-150711-4084312256-5050-20769-0
- 8. MODULES Experimental support for Mesos 0.21.0
- 10. LOGGER MODULES (FROM 0.27.0) Default logger writes to disk Writing a Custom ContainerLogger is not easy https://github.com/cloudflare/complainer
- 12. DEPLOYMENT Inmutability: Bake big AMI's (need to contain all services) Too many boot steps (AWS -> Mesos -> Marathon -> Chronos)
- 14. KUBERNETES VS MESOS "Is like compare apples to oranges"
- 15. OUR OWN MESOS OFFER def jobInSchibsted(offer: Offer, people: *Person, executorInfo: ExecutorInfo) val peopleResource = Resource.newBuilder .setType(SCALAR) .setName("people") .setScalar(Scalar.newBuilder.setValue(people)) .setRole("Systems engineer") .build
- 16. Link to zeus speak