Latest news about The JValue Project
-
MADE Summer 2023 Student Projects
Every semester, in our course on Methods of Advanced Data Engineering (MADE), students work with Python and Jayvee, our domain-specific language to model data pipelines as part of the JValue project. During the semester, they also complete a data science project of their choice using open data. Below, please find links to two projects we…
-
Final Thesis: Syntactic Interoperability in Microservice-based Architectures
Abstract: Nowadays, many applications are developed using a microservice-based architecture. In this context, a software product consists of many individually developed services that communicate over a network. As microservices do not necessarily share a common code base, syntactic interoperability remains a major challenge with this architectural style. The objective of this work is to provide…
-
Final Thesis: Guidelines für die Integration von User Interfaces in Microservice-basierten Systemen
Abstract: Microservice-based systems consist of loosely coupled, independent distributed services, communicating over the network. The integration of the frontend in microservices is a central problem. In contrast to the back end services, one independent service is often used for the front end of an application. This contradicts the principle of microservice-based systems, since a central,…
-
Final Thesis: ETL Data Pipelines Configurations in Spark
Abstract: The JValue Open Data Service (ODS) is an ETL data pipeline that provides data extraction from different source systems (Extract), performs transformations on the extracted data (Transform), and loads the data to a target database (Load). There are different kinds of stream processing engines that cope with data that have high volume, variety, and…
-
Final Thesis: Design and Implementation of a Version Control System for Open Data Modelling Projects
Abstract: Many modern software applications and research projects depend on the ability to access high-qualitative data sources. Even though there is already a large number of openly available data sets, such data sets are often hard to (re)use due to various barriers such as incomplete documentation, wrong or missing values, and more. To address these…
-
Final Thesis: A Study and Analysis of the Performance of the JValue Open Data Service as Part of a Data Pipeline Supporting An Online Learning Model
Abstract: Open data has been known for having data quality issues that require complex data cleansing and data transformation in order to be usable for data analysis, data visualization, training machine learning algorithms, and other data science activities. Open Data Service (ODS) is a software project that aims at creating an interface for reliable and…
-
Final Thesis: Giving Structure to Open Data in the JValue ODS
Abstract: Nowadays the internet provides a lot of open data for public use. Those can be written in various data types and cover plenty of subjects. Because of that the absence of a standard results into the main problem. Every provider can decide for himself how the data is constructed. The JValue project is dedicated…
-
Final Thesis: Implementing an Open Data ETL Processing Engine with Kafka
Abstract: The JValue project group is developing a modeling ecosystem for Extract Transform Load (ETL) processes. Part of this ecosystem is a description model for those. This thesis suggests a conversion process from the description model into an Apache Kafka runtime, described in a cloud-native format, like Docker Compose. The conversion is implemented as a…
-
Final Thesis: Elasticity Concept for Microservice-based System
Abstract: Software Elasticity is the concept of adapting available resources to the current or expected workload. This concept fits modern and stateless microservice architectures, which are scalable by design. Their scalability is closely related to Software Resilience and places new demands on cloud architectures. The JValue Open Data Service (JValue ODS) is an open data…