Deploy with Edge Orchestrator#

Edge Orchestrator, part of Intel’s Edge Software, simplifies edge application deployment and management, making it easier to deploy edge solutions at scale. Edge Orchestrator provides:

Secure Infrastructure Management: Offers secure and efficient remote onboarding and management of your edge node fleet across sites and geographies. Zero-trust security configuration reduces the time required to secure your edge applications.
Deployment Orchestration and Automation: Lets you roll out and update applications and configure infrastructure nodes across your network from a single pane of glass. Edge Orchestrator provides automated cluster orchestration and dynamic application deployment.
Automated Deployment: Automates the remote installation and updating of applications at scale.
Deep Telemetry: Gives you policy-based Lifecycle management and centralized visibility into your distributed edge infrastructure and deployments.
Flexible Configuration: From organizing your physical infrastructure to managing the permutations of executing applications in a variety of runtime environments,Edge Orchestrator gives you flexibility to define the policies, criteria, and hierarchies that make the most sense for your specific business needs.

To deploy the ChatQ&A application with the Edge Orchestrator follow the steps described in the document

Procedure to Deploy with Edge Orchestrator#

Prerequisites#

Access to the web interface of the Edge Orchestrator with one or more Edge Nodes Onboarded to the Edge Orchestrator.
Clusters with privileged template have been created on the needed Edge Nodes following the procedures described in Create Cluster

Making available Deployment Package#

Clone the ChatQ&A Repo Clone the repository.
```
git clone <repository-url>
cd <repository-url>/sample-applications/chat-question-and-answer
```
The official repository-url is https://github.com/open-edge-platform/edge-ai-libraries. In case of forked repos, please ensure the right url is used when cloning the repo.
From the web-browser open the URL of the Edge Orchestrator and Import the Deployment Package present in the folder deployment-package following the steps described in Import Deployment Package
Once the deployment package has been imported into Edge Orchestrator, you can see it in the list of Web UI as shown here.

See Deployment Packages for more information on deployment packages.

Deploy the Application onto the Edge Nodes#

To set up a deployment:

Click the Deployments tab in the top menu to view the Deployments page. On the Deployments page, you can view the list of created deployments. The status indicator shows a quick view of the status of the deployment that depends on many factors.
Select Deployments tab and click the Setup a Deployment button. The Setup a Deployment page appears.
In the Setup a Deployment page, select the chat-question-and-answer package for the deployment from list, and click Next. The Select a Profile step appears:
In the Select a Profile step, select the deployment profile, and click Next. The Override Profile Values page appears.
The Override Profile Values page shows the deployment profile values that are available for overriding. Provide the necessary overriding values, then click Next to proceed to the Select Deployment type step.
In the Select Deployment type page, select the type of deployment.
1. If you select Automatic as the deployment type, enter the deployment name and metadata in key-value format to select the target cluster.
2. If you select Manual as the deployment type, enter the deployment name and select the clusters from the list of clusters.
Click Next to view the Review page.
Verify if the deployment details are correct and click Deploy.

After a few minutes, the deployment will start and will take about 5 minutes to complete.

In the Edge Orchestrator Web UI, you can track the application installation through the View Deployment Details view.

ChatQ&A sample application is fully deployed when the applications become green and the status is shown as Running.

You can view the deployment status on the Deployments page.

Note: If the deployment fails for any reason, the deployment status will display the “Error” or “Down” status.

For more information on setting up a deployment, See Set up a Deployment

Access the ChatQ&A AI-Suite#

Download the kubeconfig of the cluster of the Edge Node on which the Application has been deployed. Refer to Kubeconfig Download
Follow the steps described in the ChatQ&A Documentation on usage of the application.

Note: Skip the Deploy helm chart step