Deploying Informatica IDMC s analytics platform on OCI A new level of data intelligence

Mondo Technology Updated on 2024-02-01

The collaboration between Oracle and Informatica combines the strengths of two industry leaders in database and data management to deliver a comprehensive ecosystem of enterprise data warehouses and lakes. This reference architecture shows how Informatica IDMC Security** works in Oracle Cloud Infrastructure (OCI). You can use more than 300 connectors to export data from a variety of on-premises and cloud sources and import it into Oracle Automation Database for use in analytics or data science processes. Without this integration, we can derive actionable information from application data, such as Oracle E-Business Suite, but we can't enrich that data with information from other data sources to unlock valuable insights. Running analytics workloads on an operating system is also not a good practice. This reference architecture positions the technology solution in the overall business context:

Integrations provide an analytics platform that contains application data that is logged interactively combined with another set of curation data in the management layer and distilled into actionable information and insights at the development layer. This reference architecture shows how Informatica IDMC Security** works in Oracle Cloud Infrastructure (OCI). Data is exported from on-premises and cloud-based enterprise applications, files, object storage, and databases, and then imported into Oracle Automation Database for use in analytics or data science processes. The following diagram is a functional representation of the reference architecture.

Overall, the schema includes the following logical partitions. This reference architecture focuses on the data refinement and data persistence architecture components: ingesting and refining data for use in each data layer of the schema.

Facilitate access and exploration of data, presenting current and historical business views. It contains raw data as well as granular and aggregated curated data. For relational techniques, data may be logically or physically structured in simple relational, vertical, dimensional, or OLAP form. For non-relational data, this tier contains one or more pools of data, either the output of the analytics process or the data optimized for a specific analytics task.

Oracle Automated Data Warehouse is a self-driving, self-protecting, self-healing database service optimized for data warehouse workloads. You don't need to configure or manage any hardware, and you don't need to install any software. Oracle Cloud Infrastructure is responsible for creating the database, as well as backing up, patching, upgrading, and tuning the database.

Abstract a logical business view of the data for consumers to use. This abstraction facilitates the adoption of agile development methodologies, migration to the target architecture, and the provision of a single reporting layer from multiple federated sources.

In the above architecture, Compute Shape hosts Informatica Cloud Security**. Informatica Cloud Security** is a lightweight program that runs all tasks and enables secure communication between your organization and the Informatica Intelligent Data Management Cloud. When a task is run securely, it connects to an Informatica Cloud hosted facility to access the task information. It connects directly and securely to sources and destinations, transfers data, orchestrates task flows, runs processes, and performs any additional task requirements. The schema consists of the following components:TenancyA tenant is a secure, separate partition within Oracle Cloud that Oracle sets up when you sign up for Oracle Cloud Infrastructure. You can create, organize, and manage resources in Oracle Cloud within your tenant. Tenant is synonymous with a company or organization. Typically, a company will have one tenant and its organizational structure will be reflected within that tenant. A single tenant is typically associated with a single subscription, and a single subscription typically has only one tenant.

RegionAn Oracle Cloud Infrastructure region is a geographically constrained region that contains one or more data centers known as availability domains. Regions are independent of other regions and may be far apart (across countries or even continents).

Ailability domainAn availability domain is an independent, autonomous data center within a region. The physical resources within each availability domain are isolated from the resources of the other availability domains, providing failure tolerance. Availability domains do not share infrastructure such as power or cooling systems, or internal availability domain networks. As a result, the failure of one availability domain is unlikely to affect other availability domains within that region.

CompartmentPartitions are logical separations across regions within an Oracle Cloud Infrastructure tenant. Use partitions to organize resources in Oracle Cloud, control access to resources, and set usage quotas. In order to control access to resources in a given partition, you need to define policies that specify who can access resources and what actions they can perform.

Virtual Cloud Networks (VCNs) and SubnetsA VCN is a customizable, software-defined network that you set up in an Oracle Cloud Infrastructure region. Like traditional data center networks, VCNs give you complete control over your network environment. A VCN can have multiple non-overlapping CIDR blocks, which you can change after you create the VCN. You can divide a VCN into subnets, which can be scoped to a region or an availability domain. Each subnet contains a series of contiguous addresses that do not overlap with other subnets in the VCN. You can change the size of the subnet after it has been created. Subnets can be public or private.

Safe listsFor each subnet, you can create security rules that specify the source, destination, and type of traffic that must be allowed in and out of the subnet.

Routing tablesThe virtual routing table contains rules that route traffic from a subnet to a destination outside of the VCN, typically through a gateway.

Internet gatewaysAn internet gateway allows traffic to be exchanged between a public subnet in a VCN and the public internet.

Network Address Translation (NAT) gatewaysThe NAT gateway enables private resources in the VCN to access hosts on the Internet without exposing those resources to incoming Internet connections.

Services GatewayThe Services Gateway provides access from the VCN to other services, such as Oracle Cloud Infrastructure Object Storage. Traffic from the VCN to Oracle services travels through the Oracle network fabric and does not traverse the Internet.

Bastion ServiceOracle Cloud Infrastructure Bastion provides limited, timed, secure access to resources that do not have public endpoints and require strict resource access controls, such as bare metal and virtual machines, Oracle MySQL Database Service, Autonomous Transaction Processing (ATP), Oracle Container Engine Kubernetes (OKE), and any other resources that allow access to the Secure Shell Protocol (SSH). With Oracle Cloud Infrastructure Bastion Service, you can enable access to private hosts without deploying and maintaining springboard hosts. In addition, you gain an improved security posture with identity-based permissions and centralized, audited, time-limited SSH sessions. Oracle Cloud Infrastructure Bastion eliminates the need for bastion access to public IPs, eliminating the hassle and potential attack surface when providing remote access.

ComputeOracle Cloud Infrastructure Compute enables you to provision and manage compute hosts in the cloud. You can launch compute instances that meet your CPU, memory, network bandwidth, and storage resource needs. Once you create a compute instance, you can securely access it, restart it, connect and disconnect the volume, and terminate it when you no longer need it.

Identity and Access Management (IAM).Oracle Cloud Infrastructure Identity and Access Management (IAM) is the access control plane for Oracle Cloud Infrastructure (OCI) and Oracle Cloud applications. The IAM API and user interface enable you to manage identity domains and the resources within them. Each OCI IAM identity domain represents a separate identity and access management solution or a distinct group of users.

StrategyOracle Cloud Infrastructure identity and access management policies specify who can access which resources, and how. Authorization happens at the group and partition level, which means you can write a policy that gives a group specific types of access within a specific partition or to a tenant.

Object storageObject storage provides fast access to large amounts of structured and unstructured data, including database backups, analytics data, and rich content such as images and data. You can securely store your data and then retrieve it directly from within the internet or cloud platform. You can seamlessly scale your storage without experiencing performance degradation or service reliability. For "hot" storage that you need fast, immediate, and frequent access, use standard storage. For "cold" storage that you retain for long periods of time and have little or no access, use archive storage.

AutomationData warehouseOracle Automated Data Warehouse is a self-driving, self-protecting, self-healing database service optimized for data warehouse workloads. You don't need to configure or manage any hardware, and you don't need to install any software. Oracle Cloud Infrastructure is responsible for creating the database, as well as backing up, patching, upgrading, and tuning the database.

Use the following recommendations as a starting point for integrating the Informatica IDMC platform on Oracle Cloud. Your needs may differ from the architecture described here. Virtual Cloud Network (VCN).When you create a VCN, determine the number of CIDR blocks you need and the size of each block based on the number of resources you plan to connect to the VCN subnet. Use CIDR blocks within a standard private IP address space.

Select a CIDR block that doesn't overlap with any other network (Oracle Cloud Infrastructure, your on-premises data center, or another cloud provider) so that you intend to set up a private connection.

Once you have created a VCN, you can change, add, and remove its CIDR blocks.

When designing subnets, consider where your traffic is going and your security needs. Connect all resources within a specific tier or role to the same subnet, which can serve as a security boundary.

Use regional subnets.

Virtual machinesand other recommendationsFor virtual machine sizes and other recommendations, see the links in the Deployment section.

Safe listsUse security lists to define inbound and outbound rules that apply to the entire subnet.

When integrating the Informatica IDMC platform on Oracle Cloud, consider the following implementation options.

Terraform ** is available as a sample stack in Oracle Cloud Infrastructure Resource Manager. You can also download it from GitHub ** and customize it according to your needs. Deploy using the sample stack in Oracle Cloud Infrastructure Explorer:

Access Oracle Cloud Infrastructure Resource Manager and enter your tenant and user credentials if you are not already signed in.

Select the region where you want to deploy the stack.

Follow the on-screen prompts and instructions to create a stack.

Once the stack is created, click the Terraform action and select Plan.

Wait for the job to complete and review the plan.

If you need to make any changes, return to the stack details page, click Edit Stack, and make the necessary changes. Then run the plan action again.

7.If you don't need to make any further changes, go back to the stack details page, click the Terraform action, and select Apply. Deploy using Terraform in GitHub:Visit GitHub.

Clone or repositorate to your local computer.

Follow the instructions in the README documentation.

As an Oracle Premier Partner, Agilewing is redefining the way enterprises experience Oracle Cloud Services. With its streamlined account opening process and best-in-class technical support, Agilewing transforms the complex process of account opening and operation into an easy, intuitive experience. With our one-stop shop, you can quickly get up and running with the full range of Oracle Cloud services, so you can seamlessly integrate into the cloud. Agilewing's AgileCDN service, combined with OCI's cloud-based services, provides a best-in-class global content acceleration solution. A strong network of more than 2,800 global POP nodes and 7,000 direct connection points ensures efficient and stable operation no matter where your business expands to the world. Leveraging the advanced technology of Oracle Cloud, Agilewing is committed to simplifying the process of cloud service building, cloud migration, and business going global. "Our partnership model provides customers with cost-effective solutions that allow them to focus more on their core business while enjoying the high performance and security of Oracle Cloud." Oracle Cloud Service, as a promising field, opens the door to new opportunities for enterprises with its high performance, security, and globally consistent service standards. Through Agilewing's professional services, both individual users and enterprises can easily enter this new era full of technological innovation and high performance. Let Agilewing start exploring Oracle Cloud Services and open the door to a whole new world today.

Related Pages