School / Prep
ENSEIRB-MATMECA
Study level
Bac + 5
Internal code
EI9IT307
Description
This course aims to familiarize students with the tools and practices involved in using DevOps in the context of data management and analysis. Students will learn to apply DevOps principles to create efficient pipelines for large-scale data collection, processing and analysis.
- DevOps concepts and fundamentals
- Containers, Docker
- NoSQL Fundamentals - TP Redis using Docker
- Indexing, Clustering - MongoDB TP using Docker
- Cloud - TP BigQuery
- Kubernetes
- Batch processing - TP Airflow using Kubernetes
- Streaming processing - TP Kafka using Kubernetes
Teaching hours
- CIIntegrated courses33h
- TIIndividual work10h
Mandatory prerequisites
relational database management systems, java
Syllabus
This course aims to familiarize students with the tools and practices involved in using DevOps in the context of data management and analysis. Students will learn to apply DevOps principles to create efficient pipelines for large-scale data collection, processing and analysis.
- DevOps concepts and fundamentals
- Containers, Docker
- NoSQL Fundamentals - TP Redis using Docker
- Indexing, Clustering - MongoDB TP using Docker
- Cloud - TP BigQuery
- Kubernetes
- Batch processing - TP Airflow using Kubernetes
- Streaming processing - TP Kafka using Kubernetes
Bibliography
Photocopies of course slides.
Assessment of knowledge
Initial assessment / Main session
| Type of assessment | Nature of assessment | Duration (in minutes) | Number of tests | Evaluation coefficient | Eliminatory evaluation mark | Remarks |
|---|---|---|---|---|---|---|
| Final inspection | Written | 120 | 0.5 | without document | ||
| Project | Report | 0.5 |
Second chance / Catch-up session
| Type of assessment | Nature of assessment | Duration (in minutes) | Number of tests | Evaluation coefficient | Eliminatory evaluation mark | Remarks |
|---|---|---|---|---|---|---|
| Final test | Oral |
