Desmistificando DevOps: Projetando Arquiteturas Efetivamente Escaláveis

Sistemas de Informação, Centro de Informática, (UFPE)

Instrutores

Professor Vinicius Cardoso Garcia ([email protected])
Professor Colaborador Vanilson Burégio ([email protected]), UFRPE
Professor Colaborador Rodrigo Elia Assad ([email protected]), UFRPE

Disciplinas

Pós-Graduação: IN0980 - Tópicos Avançados em Engenharia de Software 3
Graduação: IF1004 - Seminários em Sistemas de Informação 3

Local

Centro de Informática, horários: segunda (17:00-18:40) e quarta (18:50-20:30), sala D004.

Aulas práticas, quando ocorreram, serão no Lab G2.

Edições passadas

Comunicação

Temos um canal no Telegram para uma comunicação mais dinâmica: Reliability Engineering Group Channel

Ementa

As modernas organizações de desenvolvimento de software exigem equipes inteiras de DevOps para automatizar e manter processos de engenharia de software e infraestrutura vitais para a organização. Nesta disciplina, os alunos terão exposição prática às habilidades, ferramentas e conhecimentos necessários para automatizar processos e infraestruturas de engenharia de software. Os alunos terão a chance de criar novas, ou ampliar, ferramentas existentes de engenharia de software e projetar um pipeline DevOps.

Bibliografia Sugerida

Não há livro texto obrigatório. Entretanto, a seguir estão alguns livros que podem ser recomendados:

The DevOps Handbook: How to Create World-Class Agility, Reliability, and Security in Technology Organizations, by Gene Kim, Patrick Debois, John Willis, Jez Humble. IT Revolution Press, 2016.
DevOps: A Software Architect's Perspective (SEI Series in Software Engineering), by Len Bass, Ingo Weber, Liming Zhu. Addison-Wesley Professional; 1 edition (May 28, 2015).
Continuous Delivery: Reliable Software Releases through Build, Test, and Deployment Automation, by Jez Humble, David Farley. Addison-Wesley Professional; Edição: 1, 2010.
Continuous Integration: Improving Software Quality and Reducing Risk, by Paul M. Duvall, Steve Matyas, Andrew Glover. Addison-Wesley Professional, 2007.
Site Reliability Engineering: How Google runs Production Systems. Edited by Betsy Beyer, Chris Jones, Jennifer Petoff and Niall Richard Murphy. O'Reilly Media, Incorporated, 2016.
DevOps na prática: entrega de software confiável e automatizada, by Danilo Sato. Casa do Código, 2013.

Research Trends

2021
N. C. Mendonça, C. Box, C. Manolache and L. Ryan, "The Monolith Strikes Back: Why Istio Migrated From Microservices to a Monolithic Architecture," in IEEE Software, vol. 38, no. 5, pp. 17-22, Sept.-Oct. 2021, doi: https://doi.org/10.1109/MS.2021.3080335.
2019
- Leonardo Leite, Carla Rocha, Fabio Kon, Dejan Milojicic, and Paulo Meirelles. 2019. A Survey of DevOps Concepts and Challenges. ACM Comput. Surv. 52, 6, Article 127 (January 2020), 35 pages. DOI: https://doi.org/10.1145/3359981
- Welder Pinheiro Luz, Gustavo Pinto, Rodrigo Bonifácio, Adopting DevOps in the real world: A theory, a model, and a case study, Journal of Systems and Software, Volume 157, 2019, 110384, ISSN 0164-1212, doi: https://doi.org/10.1016/j.jss.2019.07.083.
- Philipp Leitner, Erik Wittern, Josef Spillner, Waldemar Hummer, A mixed-method empirical study of Function-as-a-Service software development in industrial practice, Journal of Systems and Software, Volume 149, 2019, Pages 340-359, ISSN 0164-1212, DOI: 10.1016/j.jss.2018.12.013.
- Architecture and Design InfoQ Trends Report - January 2019, by Daniel Bryant & Thomas Betts & Charles Humble, Jan 24, 2019.
2018
- Forsgren, N., & Kersten, M. (2018). DevOps metrics. Communications of the ACM, 61(4), 44–48.
- Guerrero, C., Lera, I., & Juiz, C. (2018). Resource optimization of container orchestration: a case study in multi-cloud microservices-based applications. The Journal of Supercomputing, 74(7), 2956–2983, 2018.
- L. Chen, "Microservices: Architecting for Continuous Delivery and DevOps," 2018 IEEE International Conference on Software Architecture (ICSA), Seattle, WA, 2018, pp. 39-397. doi: 10.1109/ICSA.2018.00013
- Xili Wan, Xinjie Guan, Tianjing Wang, Guangwei Bai, Baek-Yong Choi, Application deployment using Microservice and Docker containers: Framework and optimization, Journal of Network and Computer Applications, Volume 119, 2018, Pages 97-109, ISSN 1084-8045.
- Ricardo Colomo-Palacios, Eduardo Fernandes, Pedro Soto-Acosta, Xabier Larrucea, "A case analysis of enabling continuous software deployment through knowledge management", International Journal of Information Management, Volume 40, 2018, Pages 186-189, ISSN 0268-4012.
- G. Pallis, D. Trihinas, A. Tryfonos and M. Dikaiakos, "DevOps as a Service: Pushing the Boundaries of Microservice Adoption," in IEEE Internet Computing, vol. 22, no. 3, pp. 65-71, May./Jun. 2018. doi: 10.1109/MIC.2018.032501519
- H. Zhu and I. Bayley, "If Docker is the Answer, What is the Question?," 2018 IEEE Symposium on Service-Oriented System Engineering (SOSE), Bamberg, 2018, pp. 152-163. doi: 10.1109/SOSE.2018.00027
- Jez Humble. 2018. Continuous delivery sounds great, but will it work here?. Commun. ACM 61, 4 (March 2018), 34-39. DOI: https://doi.org/10.1145/3173553.
- G. Pallis, D. Trihinas, A. Tryfonos and M. Dikaiakos, "DevOps as a Service: Pushing the Boundaries of Microservice Adoption," in IEEE Internet Computing, vol. 22, no. 3, pp. 65-71, May./Jun. 2018. doi: 10.1109/MIC.2018.032501519
2017
- M. Waseem and P. Liang, "Microservices Architecture in DevOps," 2017 24th Asia-Pacific Software Engineering Conference Workshops (APSECW), Nanjing, 2017, pp. 13-14. doi: 10.1109/APSECW.2017.18.
- Bass, L. (2017). The Software Architect and DevOps. IEEE Software, 35(1), 8–10. https://doi.org/10.1109/MS.2017.4541051.
- Jaemyoun Lee and Kyungtae Kang. 2017. Poster: A Lightweight Live Migration Platform with Container-based Virtualization for System Resilience. In Proceedings of the 15th Annual International Conference on Mobile Systems, Applications, and Services (MobiSys '17). ACM, New York, NY, USA, 158-158. DOI: 10.1145/3081333.3089302.
- Eddie Antonio Santos, Carson McLean, Christopher Solinas, Abram Hindle, How does Docker affect energy consumption? Evaluating workloads in and out of Docker containers, 2 May 2017.
- M. Kassab, J. F. DeFranco and P. A. Laplante, "Software Testing: The State of the Practice," in IEEE Software, vol. 34, no. 5, pp. 46-52, 2017. doi: 10.1109/MS.2017.3571582
- R. Valerdi, "Why Software Is Like Baseball," in IEEE Software, vol. 34, no. 5, pp. 7-9, 2017. doi: 10.1109/MS.2017.3571583
- M. Kersten, "Value Stream Architecture," in IEEE Software, vol. 34, no. 5, pp. 10-12, 2017. doi: 10.1109/MS.2017.3571573
- E. Woods, "Should Architects Code?," in IEEE Software, vol. 34, no. 5, pp. 20-21, 2017. doi: 10.1109/MS.2017.3571574
- M. Waseem and P. Liang, "Microservices Architecture in DevOps," 2017 24th Asia-Pacific Software Engineering Conference Workshops (APSECW), Nanjing, 2017, pp. 13-14. doi: 10.1109/APSECW.2017.18.
- J. C. Carver, B. Penzenstadler, A. Serebrenik and A. Yamashita, "The Human Factor," in IEEE Software, vol. 34, no. 5, pp. 90-92, 2017. doi: 10.1109/MS.2017.3571580
- K. Carter, "Francois Raynaud on DevSecOps," in IEEE Software, vol. 34, no. 5, pp. 93-96, 2017. doi: 10.1109/MS.2017.3571578
- Y. Zhao, A. Serebrenik, Y. Zhou, V. Filkov and B. Vasilescu, "The impact of continuous integration on other software development practices: A large-scale empirical study," 2017 32nd IEEE/ACM International Conference on Automated Software Engineering (ASE), Urbana, IL, 2017, pp. 60-71.
- Lianping Chen, Continuous Delivery: Overcoming adoption challenges, Journal of Systems and Software, Volume 128, 2017, Pages 72-86, ISSN 0164-1212, https://doi.org/10.1016/j.jss.2017.02.013.
- Nane Kratzke, Peter-Christian Quint. Understanding cloud-native applications after 10 years of cloud computing - A systematic mapping study. Journal of Systems and Software, Volume 126, 2017, Pages 1-16, ISSN 0164-1212. doi: 10.1016/j.jss.2017.01.001.
- Eero Laukkanen, Juha Itkonen, Casper Lassenius, Problems, causes and solutions when adopting continuous delivery—A systematic literature review, Information and Software Technology, Volume 82, 2017, Pages 55-79, ISSN 0950-5849, https://doi.org/10.1016/j.infsof.2016.10.001.
- Pilar Rodríguez, Alireza Haghighatkhah, Lucy Ellen Lwakatare, Susanna Teppola, Tanja Suomalainen, Juho Eskeli, Teemu Karvonen, Pasi Kuvaja, June M. Verner, Markku Oivo. Continuous deployment of software intensive products and services: A systematic mapping study. In: Journal of Systems and Software, Volume 123, 2017, Pages 263-291, ISSN 0164-1212. doi: 10.1016/j.jss.2015.12.015.
- Brian Fitzgerald, Klaas-Jan Stol, Continuous software engineering: A roadmap and agenda, Journal of Systems and Software, Volume 123, 2017, Pages 176-189, ISSN 0164-1212, https://doi.org/10.1016/j.jss.2015.06.063.
- C. Pahl, A. Brogi, J. Soldani and P. Jamshidi, "Cloud Container Technologies: a State-of-the-Art Review," in IEEE Transactions on Cloud Computing, 2017. doi: 10.1109/TCC.2017.2702586
- Erich, FMA, Amrit, C, Daneva, M. A qualitative study of DevOps usage in practice. J Softw Evol Proc. 2017; 29: e1885. doi: 10.1002/smr.1885
- Viral Gupta, P.K. Kapur, Deepak Kumar, "Modeling and measuring attributes influencing DevOps implementation in an enterprise using structural equation modeling", Information and Software Technology, Volume 92, 2017, Pages 75-91, ISSN 0950-5849, https://doi.org/10.1016/j.infsof.2017.07.010.
- C. Barna, H. Khazaei, M. Fokaefs and M. Litoiu, "Delivering Elastic Containerized Cloud Applications to Enable DevOps," 2017 IEEE/ACM 12th International Symposium on Software Engineering for Adaptive and Self-Managing Systems (SEAMS), Buenos Aires, 2017, pp. 65-75. doi: 10.1109/SEAMS.2017.12
- O'Connor, RV, Elger, P, Clarke, PM. "Continuous software engineering—A microservices architecture perspective". J Softw Evol Proc. 2017; 29: e1866. DOI: 10.1002/smr.1866
- M. Waseem and P. Liang, "Microservices Architecture in DevOps," 2017 24th Asia-Pacific Software Engineering Conference Workshops (APSECW), Nanjing, 2017, pp. 13-14. doi: 10.1109/APSECW.2017.18.
2016
- H. Kang, M. Le and S. Tao, "Container and Microservice Driven Design for Cloud Infrastructure DevOps," 2016 IEEE International Conference on Cloud Engineering (IC2E), Berlin, 2016, pp. 202-211. doi: 10.1109/IC2E.2016.26
- Savor, T., Douglas, M., Gentili, M., Williams, L., Beck, K., & Stumm, M. (2016). Continuous deployment at Facebook and OANDA. In Proceedings of the 38th International Conference on Software Engineering Companion - ICSE ’16 (pp. 21–30). New York, New York, USA: ACM Press.
- M. Ficco, C. Esposito, H. Chang and K. R. Choo, "Live Migration in Emerging Cloud Paradigms," in IEEE Cloud Computing, vol. 3, no. 2, pp. 12-19, Mar.-Apr. 2016. doi: 10.1109/MCC.2016.48
- Spinellis, D. (2016). Being a DevOps Developer. IEEE Software, 33(3), 4–5. doi: 10.1109/MS.2016.76
- Brendan Burns, Brian Grant, David Oppenheimer, Eric Brewer, John Wilkes. Borg, Omega, and Kubernetes. Communications of the ACM, May 2016, Vol. 59 No. 5, Pages 50-57. doi: 10.1145/2890784.
- Sergei Arnautov, Bohdan Trach, Franz Gregor, Thomas Knauth, Andr ́e Martin, Christian Priebe, Joshua Lind, Divya Muthukumaran, Dan O’Keeffe, Mark Still- well, David Goltzsche, David M. Eyers, Ru ̈diger Kapitza, Peter R. Pietzuch, and Christof Fetzer. SCONE: Secure Linux Containers with Intel SGX. In 12th USENIX Symposium on Operating Systems Design and Implementation, OSDI 2016, Savan- nah, GA, USA, November 2-4, 2016., pages 689–703, 2016.
- Riungu-Kalliosaari, L., Mäkinen, S., Lwakatare, L. E., Tiihonen, J., & Männistö, T. (2016). DevOps Adoption Benefits and Challenges in Practice: A Case Study. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) (Vol. 10027 LNCS, pp. 590–597).
- L. Zhu, L. Bass and G. Champlin-Scharff, "DevOps and Its Practices," in IEEE Software, vol. 33, no. 3, pp. 32-34, May-June 2016. doi: 10.1109/MS.2016.81
- H. Kang, M. Le and S. Tao, "Container and Microservice Driven Design for Cloud Infrastructure DevOps," 2016 IEEE International Conference on Cloud Engineering (IC2E), Berlin, 2016, pp. 202-211. doi: 10.1109/IC2E.2016.26
- A. Balalaie, A. Heydarnoori and P. Jamshidi, "Microservices Architecture Enables DevOps: Migration to a Cloud-Native Architecture," in IEEE Software, vol. 33, no. 3, pp. 42-52, 2016. doi:10.1109/MS.2016.64
- Schermann G, Cito J, Leitner P, Zdun U, Gall H. 2016. An empirical study on principles and practices of continuous delivery and deployment. PeerJ Preprints 4:e1889v1. DOI: 10.7287/peerj.preprints.1889v1.
- Ebert, C., Gallardo, G., Hernantes, J., & Serrano, N. (2016). DevOps. IEEE Software, 33(3), 94–100. https://doi.org/10.1109/MS.2016.68
2015
- C. Pahl, "Containerization and the PaaS Cloud," in IEEE Cloud Computing, vol. 2, no. 3, pp. 24-31, May-June 2015. doi: 10.1109/MCC.2015.51
- Gerry Gerard Claps, Richard Berntsson Svensson, Aybüke Aurum, On the journey to continuous deployment: Technical and social challenges along the way, Information and Software Technology, Volume 57, 2015, Pages 21-31, ISSN 0950-5849, https://doi.org/10.1016/j.infsof.2014.07.009.
- Lwakatare L.E., Kuvaja P., Oivo M. (2015) "Dimensions of DevOps". In: Lassenius C., Dingsøyr T., Paasivaara M. (eds) Agile Processes in Software Engineering and Extreme Programming. XP 2015. Lecture Notes in Business Information Processing, vol 212. Springer, Cham

Objetivos

Espera-se que os alunos vivenciem exposição prática a ferramentas, processos e princípios de engenharia de software através de projetos práticos, enquanto compreendem modelos e ideias de pesquisa por trás das ferramentas e processos. As aulas incluirão experiências de aprendizagem no estilo de workshops, onde os alunos irão trabalhar em um problema e receberão comentários do professor, colaboradores convidados e outros colegas de classe. Quando possível, palestras convidadas da indústria ajudarão a ilustrar exemplos de como a tecnologia é implantada na prática.

Metodologia

Na disciplina, será utilizada uma mistura de aulas tradicionais com atividades e workshops em sala de aula. Durante as aulas, abordaremos conceitos básicos relacionados aos tópicos a serem tratados na disciplina. Durante os workshops em sala de aula, realizaremos exemplos de exercícios com ferramentas relevantes que reforçam o material de aula. As avaliações serão baseadas nas aulas, exercícios dirigidos, workshops e o projeto final.

Pré-Requisitos

Para participar deste curso é desejável que os participantes tenham:

Conhecimento básico de inglês técnico para leitura, estudo e acompanhamento das atividades propostas, uma vez que a maior parte do material disponível está em inglês.
Conhecimento básico de arquitetura de computador, sistemas operacionais, redes, engenharia de software e banco de dados.
Conhecimento de modelos de processo de desenvolvimento de software, em especial Metodologias Ágeis, testes de software. COnhecimento em TDD e BDD serão uma vantagem. Maiores informações podem ser consultadas no site da disciplina de Engenharia de Software (IF977).
Experiência em sistemas de computação, armazenamento, infraestruturas de rede e computação em nuvem será uma vantagem.

Recursos

Play-with-docker: a simple, interactive and fun playground to learn Docker
Play-with-k8s
- Introducing PWK (play with K8s)
Spring Cloud Microservice Example

Artigos

Glossário de Ferramentas

http://newrelic.com/devops/toolset

Referências de outros cursos correlatos

DevOps: CSC 519, Prof. Chris Parnin, NC State University
Desenvolvimento de Aplicações com Arquitetura Baseada em Microservices, Prof. Vinicius Garcia, Centro de Informática - UFPE
Programação para a Web 2, Prof. Diego Pessoa, CST em Análise e Desenvolvimento de Sistemas, IFPB - Campus Cajazeiras

Avaliação

Projeto em equipe com até 3 membros [70%]
- Caráter puramente acadêmico e educacional. O projeto vai tratar de diversos aspectos do desenvolvimento de uma aplicação, serviço ou solução de apoio ao paradigma DevOps no ciclo de vida de software.
- O projeto é constituído da solução e todos os artefatos que a compõem (i.e. código fonte, imagens, arquivos de configuração, scripts, documentações de apoio, entre outras), um relatório técnico final contendo a contextualização, escopo, tomadas de decisão, documentação da arquitetura da solução, projeto de implantação, etc.
- A apresentação oral do projeto também conta como uma parte da avaliação do mesmo, todos os membros do time devem estar presentes.
- Observações:
  - Entrega fora do prazo: redutor de 1 ponto por dia de atraso.
  - Atraso máximo: 1 (uma) semana. Após esse prazo, será dada nota zero para a respectiva atividade de avaliação.
  - Trabalhos com referências bibliográficas inconsistentes terão um redutor no conteúdo técnico.
  - Trabalhos “CTRL-C + CTRL-V” terão nota zero (vale tanto para cópia de colegas, como para trabalhos copiados da internet).
Exercício Escolar Teórico Individual e/ou Atividades Práticas Individuais [30%]
- Exercício com questões objetivas
Como atividade de recuperação é proposta a aplicação de um Exercício Escolar abordando os temas apresentados e discutidos em classe.

Plano de aulas

Classes	Topics	Resources	Assignments
Aug-05	Welcome, Methodology, Course Introduction (Core Topics)	Paper-01 & Post-01	HW1
Aug-07	Background: What is DevOps (Chapter 1 from Len Bass' book)	Paper-02	HW2
Aug-12	Background: The Cloud as a Platform (Chapter 2 from Len Bass' book)	Suggestion	Paper-03
Aug-14	Background: Operations (Chapter 3 from Len Bass' book)	Paper-04	HW3
Aug-19	The Deployment Pipeline: Overall Architecture (Chapter 4 from Len Bass' book)
Aug-21	The Deployment Pipeline: Building and Testing (Chapter 5 from Len Bass' book)		HW4
Aug-26	The Deployment Pipeline: Deployment (Chapter 6 from Len Bass' book)		HW12
Aug-28	Containerizing with Docker	Docker CheatSheet Docker Commands — The Ultimate Cheat Sheet	HW13
Sep-02	Docker Fundamentals (exercises 1-18)		HW13
Sep-04	Docker Fundamentals (exercises 1-18)		HW13
Sep-09	Seminar "The Deployment Pipeline: Scalability Issues"	Paper-05 and Paper-06
Sep-11	Seminar "The Deployment Pipeline: Scalability Issues"	Paper-05 and Paper-06
Sep-16	Crosscutting Concerns: Monitoring (Chapter 7 from Len Bass' book)
Sep-18	Crosscutting Concerns: Monitoring	Exercises
Sep-23	Crosscutting Concerns: Security and Security Audits (Chapter 8 from Len Bass' book)
Sep-25	Other *Ilities (Chapter 9 from Len Bass' book)	Paper-07	HW6
Sep-30	Managing Dockerized Microservices with Mesos and Marathon 1/2
Oct-02	Managing Dockerized Microservices with Mesos and Marathon 2/2
Oct-07	Introduction to Kubernetes 1/2
Oct-09	Introduction to Kubernetes 2/2
Oct-14	Presentation and project		PROJECT
Oct-16	Read Architectural Design Decisions Papers	Paper-8 & Paper-9
Oct-21	Migrating Applications to Native Cloud Architectures	Post-02	HW8
Oct-23	Migrating Applications to Native Cloud Architectures	Post-03	HW9
Oct-28	Business Considerations (Chapter 10 from Len Bass' book)		HW10
Oct-30	Moving into the Future & The Future of DevOps (Chapters 14 & 15 from Len Bass' book)
Nov-04	DevOps Projects proposal presentation
Nov-06	DevOps Projects execution
Nov-11	DevOps Projects execution
Nov-13	DevOps Projects execution
Nov-18	DevOps Projects execution
Nov-20	DevOps Projects execution
Nov-25	DevOps Projects execution
Nov-27	DevOps Projects execution
Dec-02	DevOps Projects final presentation
Dec-04	2a Chamada
Dec-09	Prova Final

Cheap and reliable Node.js hosting starts at $3/month, and $1/month static HTML hosting

IF1004 / if1004

Labels

Projects that are alternatives of or similar to if1004