Migração de Aplicações para a Cloud
Data
2023-12-07
Autores
Título da revista
ISSN da revista
Título do Volume
Editora
Resumo
O presente relatório abrange a pesquisa, o desenvolvimento e as conclusões obtidas do estágio curricular na empresa Softinsa no centro de inovação da empresa em Vila Real. O estágio consistiu no estudo da tecnologia SingleStore e na sua aplicação numa prova de conceito de migração das bases de dados SQL Server da aplicação IALogging. Neste sentido, foi realizado um estudo inicial sobre o conceito de migração de uma base de dados, sobre as caracteristicas da SingleStore e de casos práticos de empresas que implementaram este tipo de renovação tecnológica de base de dados. Este estudo foi relevante porque permitiu fazer uma análise critica sobre a necessidade e as possíveis vantagens da renovação tecnologia na aplicação IALogging. A migração das bases de dados SQL Server da aplicação IALogging para SingleStore consistiu na conversão dos scripts das bases de dados compostos por tabelas e procedimentos. Parte do processo de conversão foi coadjuvado pela ferramenta online de conversão SQLines e por um programa criado em C# para automatizar o processo. Dado a aplicação estar desenvolvida para lidar com dados em XML e Singlestore não suportar este formato os procedimentos associados á leitura e escrita neste formato tiveram de ser alterados para funcionar no formato JSON. Para além disso, uma nova tecnologia de BD requere uma alteração no código da aplicação, mais concretamente na forma como a conexão e as chamadas dos procedimentos são feitas às bases de dados. Um projeto em .NET Framework foi criado para entender estas modificações onde foi estabelecida a conexão e feita a chamada de procedimentos a uma das BD. Para tirar partido das funcionalidades da SingleStore, foi proposto a utilização das funções de pesquisa da tecnologia para melhorar as funcionalidades de consulta de dados na aplicação. Após a realização do estágio, foi possível concluir que a migração de base de dados entre as duas tecnologias em estudo é viável, porém as ferramentas de conversão entre tecnologias de diferentes formatos, como é o caso, são limitadas. Contudo, a ausência de chaves estrangeiras e impossibilidade de definir restrições de valores na criação de tabelas em SingleStore implicam um esforço adicional, exigindo a criação de procedimentos para replicar o mesmo comportamento. Além disso, a limitação na leitura e manipulação de dados em XML nesta tecnologia cria desafios em aplicações projetadas para tal fim, como no caso da IALogging em que é necessário recorrer a outro formato de dados e implementar ajustes na aplicação. A opção por uma base de dados que pode ser hospedada por um fornecedor como é o caso da SingleStore oferece vantagens em relação ao método tradicional no qual a empresa é responsável pela sua administração. As vantagens incluem a eliminação da necessidade de manutenção de servidores, a facilidade de escalar recursos para atender ao aumento dos volumes de dados e a garantia de tolerância a falhas. Estas características são fundamentadas pelos casos práticos de migração de base de dados para SingleStore nas empresas SIEMIENS e DailyVest. As funções de pesquisa por texto da SingleStore são uma componente que foi sugerida como possível implementação na aplicação IALogging para melhorar as consultas utilizando texto.
The present report encompasses the research, development, and conclusions derived from the curricular internship within the scope of the Master's degree in Computer Science at the Softinsa company's innovation center in Vila Real. The internship entailed a study of Singlestore technology and its application in a proof of concept for the migration of an SQL Server database of the IALogging application. In this context, an initial study was conducted on database migration, followed by an exploration of SingleStore's characteristics, which were necessary to discuss the need for technological renewal and the limitations and advantages of the technology within the application. The migrating process of the SQL Server databases from the IALogging application to SingleStore included the convertion of the scripts made up of tables and procedures. Part of the conversion process was supported by the SQLines online conversion tool and a program created in C# to automate the process. Since the application was developed to deal with data in XML, and Singlestore does not support this format, the procedures associated with reading and writing in this format had to be changed to work in the JSON format instead. Furthermore, a new DB technology requires a change in the application code, more specifically in the way in which connection and procedure calls are made to the databases. A project in .NET Framework was created to understand these modifications where the connection was established and procedures were called to one of the DBs. To take advantage of SingleStore's functionalities, it was proposed to use the technology's search functions to improve the data query functionalities in the application. After completing the internship, it was concluded that migrating a database between the two studied technologies is feasible. However, as in this case, the tools for converting between technologies with different formats are limited. Additionally, the absence of foreign keys and the inability to define value constraints when creating tables in SingleStore require additional effort, necessitating the creation of procedures to replicate the same behavior. Furthermore, the limitations in reading and manipulating XML data in this technology pose challenges for applications designed for such purposes, as exemplified by the IALogging application, where an alternative data format must be employed along with necessary application adjustments. Opting for a database hosted by a provider, as is the case with SingleStore, offers advantages over the traditional method where the company is responsible for administration. These advantages include eliminating the need for server maintenance, the ease of resource scaling to accommodate data volume growth and ensuring fault tolerance. The technology under study has proven suitable for supporting applications dealing with significant data volume and requiring real-time presentation of analytical operations results, as demonstrated by practical case studies of companies such as SIEMENS and DailyVest. The SingleStore's text search functions were proposed as a potential implementation within the IALogging application to enhance text-based queries.
The present report encompasses the research, development, and conclusions derived from the curricular internship within the scope of the Master's degree in Computer Science at the Softinsa company's innovation center in Vila Real. The internship entailed a study of Singlestore technology and its application in a proof of concept for the migration of an SQL Server database of the IALogging application. In this context, an initial study was conducted on database migration, followed by an exploration of SingleStore's characteristics, which were necessary to discuss the need for technological renewal and the limitations and advantages of the technology within the application. The migrating process of the SQL Server databases from the IALogging application to SingleStore included the convertion of the scripts made up of tables and procedures. Part of the conversion process was supported by the SQLines online conversion tool and a program created in C# to automate the process. Since the application was developed to deal with data in XML, and Singlestore does not support this format, the procedures associated with reading and writing in this format had to be changed to work in the JSON format instead. Furthermore, a new DB technology requires a change in the application code, more specifically in the way in which connection and procedure calls are made to the databases. A project in .NET Framework was created to understand these modifications where the connection was established and procedures were called to one of the DBs. To take advantage of SingleStore's functionalities, it was proposed to use the technology's search functions to improve the data query functionalities in the application. After completing the internship, it was concluded that migrating a database between the two studied technologies is feasible. However, as in this case, the tools for converting between technologies with different formats are limited. Additionally, the absence of foreign keys and the inability to define value constraints when creating tables in SingleStore require additional effort, necessitating the creation of procedures to replicate the same behavior. Furthermore, the limitations in reading and manipulating XML data in this technology pose challenges for applications designed for such purposes, as exemplified by the IALogging application, where an alternative data format must be employed along with necessary application adjustments. Opting for a database hosted by a provider, as is the case with SingleStore, offers advantages over the traditional method where the company is responsible for administration. These advantages include eliminating the need for server maintenance, the ease of resource scaling to accommodate data volume growth and ensuring fault tolerance. The technology under study has proven suitable for supporting applications dealing with significant data volume and requiring real-time presentation of analytical operations results, as demonstrated by practical case studies of companies such as SIEMENS and DailyVest. The SingleStore's text search functions were proposed as a potential implementation within the IALogging application to enhance text-based queries.
Descrição
Palavras-chave
Migração de base de dados , Conversão de scripts