School / Prep
ENSEIRB-MATMECA
Study level
Bac + 5
Internal code
EI9IT307
Description
This course aims to familiarize students with the tools and practices involved in using DevOps in the context of data management and analysis. Students will learn to apply DevOps principles to create efficient pipelines for large-scale data collection, processing and analysis.
- DevOps concepts and fundamentals
- Containers, Docker
- NoSQL Fundamentals - TP Redis using Docker
- Indexing, Clustering - MongoDB TP using Docker
- Cloud - TP BigQuery
- Kubernetes
- Batch processing - TP Airflow using Kubernetes
- Streaming processing - TP Kafka using Kubernetes
Teaching hours
- CIIntegrated courses33h
- TIIndividual work10h
Mandatory prerequisites
relational database management systems, java
Syllabus
This course aims to familiarize students with the tools and practices involved in using DevOps in the context of data management and analysis. Students will learn to apply DevOps principles to create efficient pipelines for large-scale data collection, processing and analysis.
- DevOps concepts and fundamentals
- Containers, Docker
- NoSQL Fundamentals - TP Redis using Docker
- Indexing, Clustering - MongoDB TP using Docker
- Cloud - TP BigQuery
- Kubernetes
- Batch processing - TP Airflow using Kubernetes
- Streaming processing - TP Kafka using Kubernetes
Bibliography
Photocopies of course slides.
Assessment of knowledge
Initial assessment / Main session - Tests
Type of assessment | Type of test | Duration (in minutes) | Number of tests | Test coefficient | Eliminatory mark in the test | Remarks |
---|---|---|---|---|---|---|
Final inspection | Written | 120 | 0.5 | without document | ||
Project | Report | 0.5 |
Second chance / Catch-up session - Tests
Type of assessment | Type of test | Duration (in minutes) | Number of tests | Test coefficient | Eliminatory mark in the test | Remarks |
---|---|---|---|---|---|---|
Final test | Oral |