awslagi.com

What is the AWS Certified Big Data – Specialty certification? AWS certifications are split into nine sub-groups. Big Data is one of the vendor’s three  Specialty  certifications—the others being Advanced Networking, and Security. As the name suggests, this badge covers all things related to big data analysis on AWS, and is aimed at professionals who’re responsible for running intricate Big Data analysis. Broadly, the certification validates your ability to implement AWS Big Data services, design and maintain Big Data infrastructure, and take advantage of AWS tools to automate parts of the analytical process. The exam is a multiple-choice, multiple-answer test, and you have 170 minutes to complete it. You’ll need to go to a local testing center to take it. The AWS Certified Big Data – Specialty certification needs to be renewed every three years. What are the prerequisites for the AWS Certified Big Data – Specialty certification? There are no prerequisites requir...

A WS BigData  provides revenue intelligence and CRM data input automation by analyzing business activities and matching them with business entities such as leads, contacts, or deals. Our matching technology is enabled by our data pipeline, which ingests and analyzes millions of activities (such as emails, meetings, or calls) on a daily basis. These activities are then used as a source to build a presentation data layer (powered by Elasticsearch), to export data to our customers, or to perform a variety of analysis and exploration tasks. Until recently, most of our data stores were either key-value or relational databases and served both online and offline data processing tasks, which required expensive replicas or oversized clusters. This approach proved to be extremely expensive and not scalable in the long run. We faced issues with offline batch jobs impacting the performance of the app as well as poor performance and bottlenecks when reading the data. That’s when we decided...

In short, I was able to move my side project — an Express.JS application — from AWS Elastic Beanstalk to Lambda+APIG. It took me less than a day and it resulted in a ~90% reduction of costs. This could be beneficial for any non-mission critical application (or environment), and I believe that it could be a game-changer for side projects and small endeavors. First of all, for full disclosure — the application in question is a  side project and not subject to any service-level agreement or performance requirements. It is a web site called  libhive . libhive scans the code in the  npm  registry and finds examples of packages using other packages. It is built in Node.JS with ExpressJS, and backed by DynamoDB. libhive gets a modest 50–150 visits daily. A couple of months ago, after I decided not to pursue this project any longer, I still wanted to keep it alive — but to minimize the maintenance costs. The site was running on Elastic Beanstalk running 2 micro insta...

Install ElasticSearch and Kibana on EC2 Amazon Linux 2 You can follow tutorial step by step to complete your task. Install requirement : Java8 Install Java8 : yum update -y  yum install -y java 1.8.0  Install ElasticSearch Create yum repo file  /etc/yum.repos.d/elasticsearch.repo Edit your repo yum install elasticsearch chkconfig --add elasticsearch Setup Kibana: Create yum repo file  /etc/yum.repos.d/kibana.repo yum install -y kibana chkconfig --add kibana Configure ES and Kibana nano  /etc/elasticsearch/elasticsearch.yml Modify  node.name, network.host, cluster.initial_master_nodes Then  nano /etc/kibana/kibana.yml Modify server.host Start ES and Kibana: systemctl start elasticsearch systemctl start kibana Access EC2 dns via port 9200 and 5601 to test. http://youripaddress:9200 http://youripaddress:5601 Review Install logstash yum -y inst...

It's quite easily for extend partition in virtual box. You can follow step by step to complete your task. In example I'm using CentOS Power off your CentOS virtual machine Go into the directory of your *.vdi image. If you don't know where it is, look at your Virtualbox Manager GUI  virtualbox -> settings -> storage -> *.vdi -> location  e.g. mine is located under  ~/VirtualBox VMs/CentOS7/CentOS.vdi Back up your image just in case anything goes wrong $ cp CentOS7.vdi CentOS7.backup.vdi Resize your virtual storage size, e.g. 200 GB $ VBoxManage modifyhd CentOS7.vdi --resize 204800 Power on your CentOS virtual machine, issue $ sudo fdisk -l    Device Boot       Start          End       Blocks    Id   System     /dev/sda1    *    ...

How To Share and Use Public AMIs in A Secure Manner When using Amazon Machine Images (AMI's) it is important to remember to use proper precautions to ensure that private information is not inadvertently left on AMI's when shared publicly.  This tutorial is provided to help customers share public Amazon Machine Images (AMIs) in a secure manner.  This tutorial expands upon the basic instructions within the "Sharing AMIs Safely" section of the EC2 User's Guide, which can be found at  http://docs.amazonwebservices.com/AWSEC2/latest/UserGuide/AESDG-chapter-sharingamis.html .  The EC2 User's Guide and this tutorial cover the most common security concerns with sharing public AMI. They should not be used as a complete security assessment guide. For information on hardening and clean-up requirements, go to Public AMI Publishing: Hardening and Clean-up Requirements, which is available at  https://aws.amazon.com/articles/9001172542712674 . Additional secur...