Extending the SDSS Batch Query System to the National Virtual Observatory Grid

Title: Extending the SDSS Batch Query System to the National Virtual Observatory Grid

Authors: María A. Nieto-Santisteban, William O'Mullane, Jim Gray, Nolan Li, Tamás Budavári, Alexander S. Szalay, Aniruddha R. Thakar

Research Question: How can the Sloan Digital Sky Survey (SDSS) Batch Query System be extended to the National Virtual Observatory (NVO) Grid to improve query execution and data transfer efficiency?

Methodology: The researchers developed a multi-queue job submission and tracking system to handle queries that take hours or days to run. They also implemented a personal database (MyDB) at the portal site for users to store and analyze data locally before extracting it to their own machines. The system was designed to work with multiple NVO nodes, allowing for distributed processing and workflow tracking services.

Results: The researchers found that the SDSS Batch Query System was not capable of handling large, complex queries efficiently. By implementing the multi-queue system and MyDB, they were able to improve query execution times and reduce the amount of data transferred over the network. This resulted in a more efficient and user-friendly system.

Implications: The extension of the SDSS Batch Query System to the NVO Grid has significant implications for astronomical research. It allows for more efficient use of resources, improves query execution times, and reduces data transfer costs. This will enable researchers to analyze larger datasets and perform more complex queries, ultimately advancing our understanding of the universe.

Link to Article: https://arxiv.org/abs/0403017v1 Authors: arXiv ID: 0403017v1