[Improvement] Replace OpenSearch High Level REST Client with Java Client

[rzo1]

What would you like to be improved?

Quoting the documentation of OpenSearch

The OpenSearch Java high-level REST client is deprecated. Support will be removed in a future version. We recommend switching to the Java client instead.

How should we improve?

We should switch to the pure Java client. I was stumbling across this issue as I was hitting opensearch-project/opensearch-java#1370 in my crawl and wanted to fix it. The recommended workaround is only suitable for the Java client and as the REST thing is deprecated, we should migrate anyway.

We need to figure out what are the replacements for the BulkProcessor and Sniffer.

[jzonthemtn]

I can potentially help with this. I have done waaaaay too much work lately converting from the rest high-level client to opensearch-java in other projects. If there is limited project urgency for to let me get more familiar with the code I can work on this.

[rzo1]

@jzonthemtn great to see you in StormCrawler 🙂. Feel free. It would be very much appreciated!