DevTech101

DevTech101

Month: February 2016

ELK and Kafka Zookeeper Configuration on Oracle BDA

July 21, 2017 / By / Leave a Comment / elasticsearch

First lets configure Kafka Note: In Kafka 8.1 (and lower) you can not delete a topic, make sure to update to a latter version then 8.2+ Modify the below Kafka settings message.max.bytes: 5000000 replica.fetch.max.bytes: 5 max.connections.per.ip: 500 To make kafka listing on all interfaces Added the following to the Advanced Snippet text field: listeners=PLAINTEXT://0.0.0.0:9092,SSL://127.0.0.1:9093 #Note: …

ELK and Kafka Zookeeper Configuration on Oracle BDA Read More »

How To Configure Elasticsearch(ELK) Hot And Warm Data

July 21, 2017 / By / Leave a Comment / elasticsearch

Configuring Elasticsearch(ELK) Hot And Warm Data movement Get the current node box status curl ‘elk1.domain.com:9200/web-sql-log-2016.02.29/_settings?pretty’ { “web-sql-log-2016.02.29” : { “settings” : { “index” : { “routing” : { “allocation” : { “require” : { “box_type” : “hot” } } }, “refresh_interval” : “5s”, “number_of_shards” : “3”, “creation_date” : “1456738651834”, “number_of_replicas” : “1”, “uuid” : “p67uw-XhQLe78sjEuDDbpg”, …

How To Configure Elasticsearch(ELK) Hot And Warm Data Read More »

Solaris Logstash Forwarder Configuration and Setup

January 18, 2023 / By / Leave a Comment / elasticsearch

Click here for the Full Install ELK and Configure Create elastic user and group groupadd elastic useradd -d /export/home/elastic -g elastic -m -s /bin/bash -c “Elastic Search” elastic Create elastic user home directory mkdir /export/home/elastic chown elastic:elastic /export/home/elastic Download logstash gz file and create directory cd /opt tar xf /var/tmp/logstash-2.2.2.tar.gz mv logstash-2.2.2 logstash Modify two …

Solaris Logstash Forwarder Configuration and Setup Read More »

Oracle Enterprise Manager, ASM Tips and Tricks

March 23, 2017 / By / Leave a Comment / Enterprise Manager 12c, Enterprise Manager 13c, Ops Center

Contents 1 To set system password 2 EM Cloud control help 3 EM cloud control process order 4 How to deploy a plugin 5 References To set system password ALTER USER system IDENTIFIED BY password; EM Cloud control help #To stop Oracle Management Service GUI only emctl stop oms # To stop all services emctl …

Oracle Enterprise Manager, ASM Tips and Tricks Read More »

How to configure beeline for hive on remote client

June 6, 2017 / By / Leave a Comment / BDA

http://www.oracle.com/technetwork/java/javase/downloads/jce-7-download-432124.html cd /usr/java/latest/jre/lib/security/ ;unzip UnlimitedJCEPolicyJDK7.zip;mv UnlimitedJCEPolicy/* . cd /opt;wget http://archive.cloudera.com/cdh5/cdh/5/hive-0.12.0-cdh5.0.0.tar.gz tar zxf hive-0.12.0-cdh5.0.0.tar.gz;mv hive-0.12.0-cdh5.0.0 hive export HADOOP_HOME=/opt/hadoop-2.6.0-cdh5.4.0 wget wget -O hive-conf.zip http://host.domain.com:7180/cmf/services/5/client-config unzip hive-conf.zip export HIVE_HOME=/export/home/cognos/hive-0.12.0-cdh5.0.0 export HIVE_CONF_DIR=/export/home/cognos/hive-conf alias hive=$HIVE_HOME/bin/hive export HADOOP_USER_CLASSPATH_FIRST=true export PATH=/usr/gnu/bin:$PATH:/export/home/cognos/hive-0.12.0-cdh5.0.0/bin:/opt/hadoop-2.6.0-cdh5.4.0/bin Source https://docs.oracle.com/cd/E63064_01/doc.42/e63062/users.htm#BIGUG328

Installing and Configuring ELK – Part six(6) – General platform tips & tricks

January 18, 2023 / By / Leave a Comment / elasticsearch

Installing and Configuring ELK – Part one(1) – Install OS (OEL 7.2), Tuning – Part two(2) – Configure KVM, Tuning – Part three(3) – install elasticsearch, configuration – Part four(4) – Install logstash, configuration – Part five(5) – Install Kibana, configuration – Part six(6) – General platform tips & tricks This is Part six(6) – …

Installing and Configuring ELK – Part six(6) – General platform tips & tricks Read More »

Installing and Configuring ELK – Part five(5) – Install Kibana, configuration

January 18, 2023 / By / Leave a Comment / elasticsearch

Installing and Configuring ELK – Part one(1) – Install OS (OEL 7.2), Tuning– Part two(2) – Configure KVM, Tuning– Part three(3) – install elasticsearch, configuration– Part four(4) – Install logstash, configuration– Part five(5) – Install Kibana, configuration– Part six(6) – General platform tips & tricks– Part six(7) Solaris logstash forwarder setup This is Part five(5) …

Installing and Configuring ELK – Part five(5) – Install Kibana, configuration Read More »

Installing and Configuring ELK – Part four(4) – Install logstash, configuration

January 18, 2023 / By / Leave a Comment / elasticsearch

Installing and Configuring ELK – Part one(1) – Install OS (OEL 7.2), Tuning– Part two(2) – Configure KVM, Tuning– Part three(3) – install elasticsearch, configuration– Part four(4) – Install logstash, configuration– Part five(5) – Install Kibana, configuration– Part six(6) – General platform tips & tricks This is Part four(4) – Install logstash, configuration Lets install …

Installing and Configuring ELK – Part four(4) – Install logstash, configuration Read More »