ZeroFox Solution: Fix project structure for Data Connector deployment

[DNRRomero]

Change(s):

• Reorganized the project structure for azure function-based data connectors in the ZeroFox Solution.

Reason for Change(s):

• The current project structure causes issues during deployment that block use by ZeroFox users

Version Updated:

• No

Testing Completed:

• Need Help

Checked that the validations are passing and have addressed any issues that are present:

• See guidance below

[DNRRomero]

Hi @v-sudkharat, we created the PR as requested

[DNRRomero]

Hey @v-sudkharat

Deployment was successful but I don't see the connectors configured, do you mind if we meet again? or can you see what is wrong from the PR?

[v-sudkharat]

@DNRRomero, I just checked the updated zip file and found that, Inside the zip there are sub-folder is created and due to that the function apps do not get displayed.
So, Could you please correct it and retest it once by taking ref. of below screenshots, and if still having issue. Please let me know will schedule a call for Tomorrow. Thanks!

1. Inside the zip file remove below highlighted folder, which is not required: -

2. Inside the zip file there is subfolder with the name "AzureFunctionZeroFoxCTI" which contain the function app. So please just place those files outside and remove that created sub-folder.

Expected : Below zi there is not subfolder added -

[DNRRomero]

Hey @v-sudkharat given your instructions, I was able to deploy our data connectors, thank you!

The app should be ready for repackaging

[v-sudkharat]

Hey @DNRRomero, The changes look good now. Could you please re-package this solution and commit the into this PR.
Regarding the connector, as it displayed into the function so please add the connector successfully connected screenshots over here for both the connector-
1. CTI connector
2. Alerts connector

After successfully connected the connector, please add screenshot link below :-

And for azure functions, need to add screenshots with function app working successfully. Thanks!

[DNRRomero]

Hi @v-sudkharat I re submitted the changes you requested and, while trying to re deploy my main template for testing I received the following error
{"code":"InvalidTemplate","message":"Deployment template validation failed: 'The template resource '/Microsoft.SecurityInsights/-dc-t36lq3wueus7i' for type 'Microsoft.OperationalInsights/workspaces/providers/contentTemplates' at line '96' and column '87' has incorrect segment lengths. A nested resource type must have identical number of segments as its resource name. A root resource type must have segment length one greater than its resource name. Please see https://aka.ms/arm-syntax-resources for usage details.'."}

[DNRRomero]

Hi @v-sudkharat I have all connectors working, can we sync?
The solution is ready for merge

[DNRRomero]

Hi @v-sudkharat
Alerts CCP connector works as expected

[v-sudkharat]

Hey @DNRRomero, Thanks for the update, I will review the content, and can we block time on 21-05-2024 for a sync?

[DNRRomero]

Hey @v-sudkharat , can it be the 20th? or better yet some day this week? the 21st is a holiday in my country

[v-sudkharat]

@DNRRomero, ok, I will send an invite over mail.

[v-sudkharat]

Hi @DNRRomero, please revert the changes for below highlighted solution folder :-

[v-sudkharat]

Remove the duplicate data connector description from Createui file and update the same into 3.0.1 zip as well. -

[v-sudkharat]

Hi @DNRRomero, Is function app started received logs for remaining data types?

[v-sudkharat]

Hi @DNRRomero, We are still waiting for your response. Thanks!

[DNRRomero]

Hi @v-sudkharat, so far the rest of the connectors have not shown up as connected.
I've been looking at the code to compare those that work with those that did not but have not found anything different, do you have an idea of what might be happening?

[v-sudkharat]

@DNRRomero, Could you please check for the Invocation logs in functions which not show as connected, and if logs are receiving the into the LAW and it still not show as connected then, need to check for Connectivity criteria inside of function app deploy file,
Thanks!

[v-sudkharat]

Hi @DNRRomero, Any update for logs for function app?

[DNRRomero]

Hi @v-sudkharat bI saw the logs and connectivity criteria and they are all standard for all connectors, could it be that not all logs are appearing in application insights?

[v-sudkharat]

@DNRRomero, It should. Can you commit latest changes and let me know so i can review it.

[DNRRomero]

Hi @v-sudkharat any chance we could meet? I've been trying to identify the issue but have not made much progress

[v-sudkharat]

@DNRRomero, Sure. we can connect. Meantime can I have demo credentials from your end to investigate the function app from my end.
Please share it mail ID, so i can check on it.

[v-sudkharat]

@DNRRomero, waiting for your response.

[DNRRomero]

Hi @v-sudkharat I sent you credentials over email a few days ago, also scheduled a meeting
will you be able to attend?

[DNRRomero]

Hi @v-sudkharat given what we discussed today, I added some changes that should fix some of the issues we have encountered so far, any other issues that may appear are related to our internal API and should be fixed under another PR upon further investigation!

[v-sudkharat]

Hi @DNRRomero, Thanks for adding changes. Kindly check on below few points : -

1. Please remove the below highlighted file which is not required: -
   

2. After checking the createUI file, find out the duplicate data connector description text, please remove one of them and add same changes into zip: -
   

3. After testing the function app, now able to see the data ingesting for 10 functions:
   

while testing remaining of them, found that the Testing Account provided to me is does not have the required permissions to get the data:

Could you please check updated connector by your Account which have the required access and data into it. And share the successfully connected screenshots with us.

Please update this branch from master.

Thanks!

[DNRRomero]

hey @v-sudkharat I added the changes requested
also here is the screenshot with the 10 connectors

[v-sudkharat]

@DNRRomero, Great. Changes looks good now. Approving the PR and proceeding to Merging it.
Please let us know if you have anything for us. Thanks!

[DNRRomero]

@DNRRomero, waiting for your response.

Hi @v-sudkharat no comments on my side, is there anything left for the PR merge?

[v-sudkharat]

Changes looks good

[v-sudkharat]

@DNRRomero, We have merged the PR. Thanks!