Beats¶
| Official Documentation: | |
|---|---|
| Beats Reference | |
Beats are a collection of open source data shippers. CAST employs a subset of these beats to facilitate data aggregation.
Filebeats¶
| Official Documentation: | |
|---|---|
| Filebeats Reference | |
Filebeats is used to ship the CSM transactional log to the big data store. It was selected for its high reliabilty in data transmission and existing integration in the elastic stack.
Installation¶
The following installation guide will deal with configuring filebeats for the CSM transaction log for a more generalized installation guide please consult the official Filebeats Reference.
- Install the filebeats rpm on the node:
rpm -ivh filebeat-*.rpm
- Configure the /etc/filebeat/filebeat.yml file:
CAST ships a sample configuration file in the ibm-csm-bds-*.noarch rpm at /opt/ibm/csm/bigdata/beats/config/filebeat.yml. This file is preconfigured to point at the CSM database archive files and the csm transaction logs. Users will need to replace two keywords before using this configuration:
| _KIBANA_HOST_PORT_: | |
|---|---|
A string containing the “hostname:port” pairing of the Kibana server. |
|
| _LOGSTASH_IP_PORT_LIST_: | |
A list of “hostname:port” pairs pointing to Logstash servers to ingest the data (current CAST recommendation is a single instance of Logstash). |
|
- Start the filebeats service.
systemctl start filebeat.service
Filebeats should now be sending injested data to the Logstash instances specified in the configuation file.