First of all thank you for your interest in Logs Data Platform and sorry for not having answered earlier, we usually respond in one business day so be sure we won't be as slow to answer in the future.
Using Metricbeats with the Logstash collector is feasible but not practical. you would have to use a mutate filter to add a "message" field in your configuration and select the fields you want to keep because we prevent messages with a number of fields > 200 fields. Moreover you would have to follow the LDP conventions.
However Metricbeats is fully compatible with Index As A Service . This feature allows you to use most products of the ELK stack transparently. Note that you should use MetricBeats 5.6.9 since the platform is currently using Elasticsearch 5.6 (It could maybe work with 6.X versions but we have not tested them)
To use it Follow the following instructions :
- Create an index on LDP As described in the documentation
- Metricbeats has a template for the mapping, but template creation on LDP IndexAAS is not permitted. You have to import the mapping by using the template in the file metricbeat.template.json provided by Metricbeat. You have to extract the _default_ part of the json file (under the object mapping) and use the mapping API to import it in your template. For your convenience, i have uploaded the mapping to import here : https://plik.root.gg/file/AXctYWxEWguhKFjm/oABx8ArTN4jyNqAJ/default_mapping. The following curl command can be used to update the mapping effortlessly :
curl -u <user>:<password> -X PUT https://<your-cluster>.logs.ovh.com:9200/logs-<yourindex>/_default_ -d "@default_mapping"
<user>:<password> is your LDP credentials (you can of course use tokens),
logs-<yourindex> is the index you created, and
default_mapping the file you just downloaded/extracted.
- Configure Metricbeats with the following settings for the elasticsearch output under
# Array of hosts to connect to.
# Optional protocol and basic auth credentials.
Launch filebeat, and you will be able to see your metrics by using the following command
curl -u <user>:<password> -X GET https://<your-cluster>.logs.ovh.com:9200/logs-<yourindex>/_search?pretty
Note that LDP is compatible with Kibana, configure it by using this documentation, if you prefer Grafana, you can click here
Last but not least : We have a dedicated Metrics Data Platform which is maybe more suited to your use case.
As Always don't hesitate to reach us here if you have any question about this response or on anything else.
And sorry again for taking that long to respond.
Happy Logging !