How to
How to set up Activity Sync from Pendula to an AWS S3 bucket

Activity sync provides a range of information about the performance of messages as they pass through your Pendula tenant. This information can be used in external systems for analytics and reporting, by connecting to the activity sync stream.

This article shows how to connect an activity sync stream from your Pendula tenant to Amazon Kinesis, and how to store that stream in an S3 bucket.

Prerequisites:

• Requires Administrator login to your AWS environment
• The Amazon Kinesis package must be enabled for your Pendula tenant

How to connect activity sync to Amazon Kinesis and S3

1. Log into your AWS Account.

2. As an Administrator, open the Management Console.

3. Search for “Kinesis” and select “Kinesis - Work with Real-Time Streaming Data”.

4. Click Create data stream.

5. Enter a Data stream name. NOTE: The Data stream name is used as the streamName when deploying a Pendula Activity Sync resource, later in this procedure.

6. Click Create data stream.

7. Copy the ARN value, so you can reference it in your policy.

8. Search for “IAM” and select “IAM - Manage access to AWS resources”.

9. In the IAM management screen, click Policies.

10. Click Create policy.

11. In the Policy editor, click the JSON button.

12. Paste the following JSON:

    {
    	"Version": "2012-10-17",
    	"Statement": [
    		{
    			"Sid": "PendulaAccess",
    			"Effect": "Allow",
    			"Action": [
    				"kinesis:GetRecords",
    				"kinesis:GetShardIterator",
    				"kinesis:ListShards",
    				"kinesis:PutRecord",
    				"kinesis:PutRecords"
    			],
    			"Resource": "Paste ARN Here"
    		}
    	]
    }
    

13. Paste the ARN for your stream into the Resource field.

14. Click Next.

15. Enter a Policy name and optionally, a Description, then click Create Policy.

16. In the IAM management screen, click Users.

17. Click Create user.

18. Enter a User name, then click Next.

19. Select Attach policies directly, and select the policy you just created.

20. Click Next.

21. Click Create user.

22. Select the user you just created.

23. Click Create access key.

24. Select Third-party service.

25. Select the Confirmation check box.

26. Click Next.

27. Click Create access key.

28. Select Third-party service as the Use case.
29. Click Next.
30. Enter a Description.
31. Click Create access key.

32. Copy and save the Access Key ID and Secret Access Key in a secure place. These credentials will be used when setting up your connection in Pendula.

33. Click Done.

34. Search for and select “S3” to create an S3 bucket.

35. Click Create bucket.

36. Enter a Bucket name and adjust settings as required for your environment, then click Create bucket.

37. Search for “Firehose” and select “Amazon Data Firehose”.

38. Click Create Firehose stream.

39. Select Amazon Kinesis Data Streams as the Source, and Amazon S3 as the Destination. Additional fields will appear after you select these.

40. In the Source settings Kinesis data stream field, select the Kinesis stream you created in step 4.

41. In the Destination settings S3 bucket field, select the bucket you created in step 32.

42. Adjust the remaining settings as required for your environment, then click Create Firehose stream.

Your Kinesis stream is now configured.

You can now set up your Amazon Kinesis connection inside your Pendula tenant.

How to connect your Pendula tenant activity sync to AWS Kinesis

After configuring your AWS Kinesis stream and S3 bucket, you can connect your Pendula tenant.

1. Log into your Pendula tenant.
2. Select the Integrations page.
3. In the Setup connection section, click Amazon Kinesis.
4. Enter a Name for the connection.
5. Enter a Description for the connection to make it easy to identify.
6. Paste your AWS Access Key ID and AWS Secret Access Key into the fields.
7. Click Save connection.

To start data streaming from Pendula, contact your Pendula representative with the name of your Kinesis data stream and the API name from your tenant connection, so they can enable the stream for your environment.