Configuration files #
To configure a source connector in Arcion, you need to configure the following components and files:
- Source connector configuration
-
This file contains the details for connecting to the source database instance. For documentation on different sources, expand the Source Connector Setup section under Sources in the left navigation menu.
- Extractor reference configuration
-
This file allows you to configure all the parameters Arcion uses while extracting data from the source database. You don’t have to change most of the parameters, but you can adjust them to optimize the extraction. For more information, see Extractor configuration.
- Filter reference configuration
-
This file allows you to specify a set of filter rules for Arcion to follow while carrying out replication. You can filter tables, views, and queries. For more information, see Filter configuration
- Source column transformation configuration
-
This file allows you to specify the transformation logic for each individual table. As Arcion processes data from source tables, it applies the transformation rules to the data, and then loads the transformed data into the destination tables. The column on the destination can either be a new column, or a source column with transformed values. For more information, see Source column transformation.
- Source query configuration
-
This file allows you to set up Arcion to perform replication based on the results of source queries from source database systems to the target database systems. Source queries can be custom queries, macros, user-defined functions (UDFs), and stored procedures. For more information, see Replication of source queries.
In Arcion Cloud and in the Arcion UI, you can configure each of the preceding files through UI screens.