A global data warehouse for astronomy
Loading...
Date
2018
Authors
Journal Title
Journal ISSN
Volume Title
Publisher
Abstract
There have been many attempts to gather and integrate numerous astronomical data
sources to create a centralized, organized and consolidated database with visualization and
analysis add-on tools. Unfortunately, most of those attempts have been inefficient, mainly,
because they lack a holistic scheme that allows for heterogeneous data integration, highlevel
pre-processing and visualization capabilities within the same structure. In industry,
the same problem was tackled back in 1960, where the concept of the Data Warehouse
was introduced as the most promising solution for the majority of the organizations. In
this paper, we bring Data Warehousing to astronomy in theory and practice. We develop
and implement an integrated astronomical Data Warehouse that allows users to visually
process and analyze astronomical data in real time, narrowing down exploratory analyses,
and providing an active interaction with data. In the current version, we implement a twolayer-
based architecture that provides an interactive and user-friendly environment, with
advanced visualization capabilities for data manipulation and data mining applied to time
domain astronomy.
Description
Tesis (Master of Science in Engineering)--Pontificia Universidad Católica, 2022
Keywords
Data Warehouse, Big Data, Catalogs, NoSQL, Cassandra and Spark