Lab2 (1)
.pdf
keyboard_arrow_up
School
Centennial College *
*We aren’t endorsed by this school
Course
101
Subject
Computer Science
Date
Apr 3, 2024
Type
Pages
3
Uploaded by HighnessBraveryButterfly42
SRT411: Digital Data Analysis Winter 2023 pg. 1
SRT411: Lab 02 (5%)
Creating an Elasticsearch Cluster Objective In this lab, you will create an ES cluster with multiple nodes. What to do To complete this lab, these objectives must be completed:
Work with clusters, nodes and data you have in Elasticsearch.
Each student will create a cluster of three Elasticsearch nodes, one will be the master and the other two will be the data nodes.
To change and check the basic cluster configurations.
Set the index pattern to configure which indices to analyze.
Students will use both the console and Kibana to work on this lab. Tasks Task 0: Create a report 1.
Create a word document, and write the details of your lab completion in it. This will serve as proof that the lab was satisfactorily completed. 2.
Each heading should be a task (Task 1, Task 2, etc.), with screenshots and descriptions that prove the task was completed satisfactorily. Fill these headings out as you complete the lab. Task 1: Create & Test the cluster
Use the machine you have created in the last lab and edit the “elasticsearch.yml”
file to set the following values: Node name:
“srt411master
” Master.node: “true” Cluster: “srt411”
Network.host: xxx.xxx.xxx.xxx
Create another two Linux servers with ES installed [ No need to install other components like Logstash and Beats ].
The second and third machines are the two new data nodes that will join the master node called “
srt411master
”.The following configuration must be set by editing “
elasticeasrch.yml”
file: 1.
[ Machine 2 ] Node name:
“srt411data1
” Node.master: “false” Node.data: “true” Cluster: “srt411”
Network.host: xxx.xxx.xxx.xxx 2.
[ Machine 3 ] Node name:
“srt411data2
” Node.master: “false” Node.data: “true” Cluster: “srt411”
Network.host: xxx.xxx.xxx.xxx
Two additional values, needs to be set for all three machines are:
discovery.zen.ping.unicast.hosts [Put IP addresses for all 3 machines here separated by “,” ]
cluster.initial_master_nodes: IP address of the master node.
Once all the THREE machines are properly configured, start the master node first and then the data nodes. Take screenshots as how you are starting your machines and in which order ?
SRT411: Digital Data Analysis Winter 2023 pg. 2
After all the three nodes are up and running, show the configuration for each node to verify their status, health and other cluster information. You can use the curl Get command on the terminal and can make use of the browser. Take screen shots of your terminal as well as the web browser displaying the machine configurations.
Elasticsearch default heap size is 1GB, change the min and max heap size to 512 MB(ideally half of the available RAM size) for each node, needs to restart the nodes to make changes in effect.
Modify the “kibana.yml”
to listen to the ES servers.
For this task, you need to take screenshots and include in your report. Don’t forget to tag the screen with your student id and timestamp while taking screen shots. Task 2: Data Query Use Kibana console for this task:
Write the command to query how many indices are there in the cluster and what are their names?
Write the command to query all documents in all indices of your cluster. By default, only the first 10 rows will be displayed.
Write the command to create a new index named “
mydata”.
Write the command to add the following two documents in the index called “
mydata
” one by one. Use _doc for the type and their respective ids. You have to provide ids while putting the data in Elasticsearch. Look for PUT and POST commands and should be able to identify the difference and pick the right command for this step. Id title category date first_name last_name company 1 Better query execution Engineering 15-Jul-21 Adrien Grand Elastic 2 The Story of Sense 28-May-21 Boaz Leskes
Write the GET command to retrieve the document with id of 1 and type _doc from the “
myData”
index.
Write the command to delete the document with id 2 from the “
myData” index.
Verify it was deleted by trying to GET it again, record the response.
Take screenshots of each command and the result of execution and include in your report. Task 3: Index Management
Take screenshot of showing the cluster health and information about your nodes using index management. Task 4:Answer the following Question
What is a cluster and node in Elasticsearch?
What are the main differences between master and data nodes?
Which type of nodes hold the documents?
Describe how ES stores data?
Describe the benefits of JSON objects.
Compare a traditional RDBMS and ES for data storage.
Your preview ends here
Eager to read complete document? Join bartleby learn and gain access to the full version
- Access to all documents
- Unlimited textbook solutions
- 24/7 expert homework help
Related Questions
Big Data Processing
One of the benefits from Graph Database is it is significantly faster than traditional RelationalDatabase System (RDBMS), especially for a database with many relations. Create a graph database of the following RDBMS tables with 3 records for each table. The Entity Relationship Diagram represents an Online Course Database. Use a graph diagram that consists of vertices and edges torepresents the graph database. Explain why a database query would be executed significantly faster in the Graph Database than the RDBMS based on the example database.
arrow_forward
ER Diagram
You are working for DroneCore, a new startup that provides a backend for drone-based companies in towns and cities around the world. Your employer tasks you with designing a database for this service. Given the following information, draw the ER diagram:
Any given startup should store information about Drones, Hubs, Employees, History entries, and Users.
A Hub has an ID associated with it.
A Drone has an ID, a model, a purchase date, and an assigned Hub, which it operates out of.
Each Employee has an ID, a name, and a salary, and works at a specific Hub.
Employees may also maintain a set of Drones. An employee can maintain any number of drones, but each drone must be maintained by exactly one employee.
Each User has an ID, a name, and a preferred Hub.
The company stores delivery History. A history item tracks a Drone's delivery to a User, and stores the departure time, the delivery number, time of arrival, and return time.
This is MYSQL
arrow_forward
Big Data Processing
One of the benefits from Graph Database is it is significantly faster than traditional Relational Database System (RDBMS), especially for a database with many relations. Create a graph database of the following RDBMS tables with 3 records for each table. The Entity Relationship Diagram represents an Online Course Database. Use a graph diagram that consists of vertices and edges to represents the graph database. Explain why a database query would be executed significantly faster in the Graph Database than the RDBMS based on the example database.
arrow_forward
Cse topic cluster analysis
Explain briefly how cluster analysis helps in analyzing the data objects
arrow_forward
Match the scenarios given in the left-hand column with the type of decomposition indicated in the right-hand
column.
Arya is responsible for buying groceries and Asia is
V [Choose]
responsible for mowing the lawn
Thread decomposition
Task flow decomposition
Weijun is responsible for cutting half of the
vegetables and Zhihui is responsible for cutting the
Data decomposition
Data flow decomposition
other half
Task decomposition
Jose is responsible for writing code and Yasmine is
[ Choose ]
responsible for testing the code
arrow_forward
Using Visual Paradigm design two diagrams one for the view layer and one for the data access layer like in the image for the "making a reservation through a web interface of a Car Sharing IS"
Please do not use AI
arrow_forward
Data Structures (Code in Python)
Create simple Restaurent Management System where Admin can Add, Delete items from linkedlist and Customer can order food and get bill.Admin functions:1 - Add items in menu (Linked List)2 - Delete items from menu (LinkedList)
Customer functions:1 - Order items from menu2 - Calculate bill
arrow_forward
Attracted by the success of Spotify, a group of students want to build their own music-streaming website called Musicmatic. Being economists, they are unaware of the specificities of databases and have therefore asked you to create an EER model.
A large number of songs will be made available through their website, and the following information on each song needs to be stored: title, year, length, and genre. Also, artist information will be added, including date of birth, name, and a URL to a website (e.g., Wikipedia page) with additional information on the artist. You can assume an artist is uniquely identified by her name, and that a song always belongs to exactly one artist. The Musicmatic students also point out that songs having the same title are possible, and only the combination of song and artist can be assumed to be unique.
The database will also have to store information on the people using Musicmatic. It was decided to only discriminate between two types of users: regular…
arrow_forward
DataBase case study: read this case study and finilize what should be the enitties that is mentioned in the case study and then make a ERD daigram of this data.
Delhi Mart is a super Store located at Mahavir Enclave, New Delhi, India. Delhi Mart has many types of products that are related to specific Category. Delhi Mart are avail many different customers to sell their products daily. Every Category is managed by a particular manager. Customer order their selected product in terms of qty and avail selected discount on the product. Delhi Mart also have staff that manage different departments in the mall. Every Customer is concern with a particular staff to resolve their queries. Every Manager is responsible to maintain the stock if the stock will out they contact their selected supplier for buying products.
arrow_forward
Course : Database system
arrow_forward
Hi please assist with a and b
thanks Computer Science Question
Datadyne inc. is a large company that has a system to manage its Data Warehouse. They would like to make some form or upgrade to the system that would enable them to streamline the way in which they perform operations as well as have a means to log which operations being done, and have been performed. One of your colleagues has suggested the following as suitable candidates for a Design Pattern to apply:
Observer Design Pattern
Object Pool Design Pattern
Command Design Pattern
(a) Which do you think is the most optimal design pattern?
(b) Discuss why you think this is an appropriate design pattern
arrow_forward
A dimensional model is used in the building of a data warehouse, but what exactly does it do?
arrow_forward
A dimensional model is employed in the construction of a data warehouse, but what precisely does it perform is unclear.
arrow_forward
Airline Reservation System
In this project, you will design and implement a simple interactive airline reservation system similar to orbitz (www.orbitz.com). The system is a typical client-server application with a web-based front-end for the user and a database backend. This project will focus only on the backend and NOT on the front end. This document provides a high-level description of the project and outlines the deliverables expected of your team. It is crucial that you have a good solid design before you start coding.
The purpose of the online system is to create convenient and easy-to-use online system for passengers, trying to buy airline tickets. The system is based on a relational database with its flight management and reservation functions. We will have a database supporting dozens of major cities around the world as well as hundreds of flights by various airline companies. Above all, we hope to provide a comfortable user experience along with the best pricing available.…
arrow_forward
Need this in 30 minutes please Just draw me the both dirgam and here is all the infomation you need for complete it
Entity-Relationship Diagram (ERD)
An ERD visually represents the relationships between entities in a database. Here's what you need:
Entities:
Product: Represents items sold by the coffee shop.
Transaction: Represents a sale event.
Payment: Represents the payment method used for transactions.
BeanCard: Represents the loyalty or prepaid cards customers can use.
Attributes:
Product: Product ID, Name, Category (Beverages, Bakery goods), Price.
Transaction: Transaction ID, Date, Total Amount.
Payment: Payment ID, Type (Cash, Credit, BeanCard), Amount.
BeanCard: Card ID, Customer ID, Balance.
Relationships:
Products to Transactions: A transaction can include multiple products (many-to-many).
Transactions to Payment: A transaction is completed with a single payment method (one-to-one).
BeanCard to Payment: A BeanCard can be used for many payments (one-to-many).
Data Flow…
arrow_forward
Please written by computer source
Please help me with this
It's from MB-500 renewal
Question 19 of 25
A company uses Dynamics 365 Supply Chain Management. The company is configuring dual-write for implementation.
You need to access the out-of-the-box data entity mappings in Dynamics 365 Supply Chain Management.
Which three actions must you complete first? Each correct answer presents part of the solution.
NOTE: Each correct selection is worth one point.
Select all answers that apply.
1.complete the health check
2.create the Microsoft Dataverse environment
3.select the legal entities to integrate
4.run the initial sync process
5.enable the dual-write application
Question 20 of 25
You are a Dynamics 365 Finance technical lead creating a value proposition presentation for using the dual-write solution.
You need to identify key concepts in dual-write that add value.
Which two concepts should you identify? Each correct answer presents part of the solution.
NOTE: Each correct selection…
arrow_forward
Relational Schema NormalizationWhen a database is “normalized” it is restructured (according to a series of normal-forms, whichwe do not discuss here) in order to reduce data redundancy and improve data integrity.Typically this means decomposing one table into two or more new tables that are newly related.You must employ the following normalizations when reducing your ER diagram to a finalrelational database schema diagram:● You must further normalize (or decompose) the sales_persons, customers, drivers,contractors, and shipments tables, so that all addresses are maintained in a new tablecalled “addresses”. In doing so, each of these five tables newly participates in amany-to-one relationship with the addresses table. The primary key of the newlycreated addresses table is called address_id and is a unique identification numberarbitrarily assigned by the logistics company.● In this assignment, all relationship sets will be eliminated from the final database design.This will be done by…
arrow_forward
Database Design
Testing (ID_testing,date,observerId)
Observer(observerId,observer_name)
Type(TypeId,typename)
Essentialoil (ID_essential,essentialname,typeId,batchcode)
Constituent (ID_constituent,cname,min_percentage,Test_percentage,status)
Before an Essential Oil product is marketed, testing is carried out based on the production batch from any essential oil. This is done to maintain the quality and content of the existing constituents in essential oils. Where the Test Percentage Content must reach the Minimum standard Percentage Content for each constituent. If there is one type of constituent that does not fulfill minimum standard, the batch will not be marketed because it does not meet the standard quality.
Question
1. Make an ERD (Entitiy Relationship Diagram) based on the results of Normalization
2. Develop the ERD that you create to implementGeneralization / Specialization.
arrow_forward
Convert the given ER diagram into relational tables and then implement the database in Mysql Workbench)
arrow_forward
Creating Data Flow DiagramsA local restaurant is planning to implement an online ordering system. Thefirst step in their project is to map out the order process and whatinformation needs to be input and output from an order.
Using an application of your choice (MS Word, Visio, Draw.io or any otheropen source tool), create the DFD Level 0 or Context Diagram of arestaurant ordering system.
After completing your context diagram, select one of the processes, then identify the items which make up the four data flow diagram elements:
(1) Data sources and destinations(2) Data flows(3) Transformation processes(4) Data stores
With the above information, complete a level 1 detailed diagram for the selected process (use the previously selected software).
arrow_forward
hand draw an entity-relationship diagram to visually represent a database design this an example, you can choose any subject
arrow_forward
Need this in 30 minutes please Just draw me the Entity-Relationship Digram and here is all the infomation you need for complete it
Entity-Relationship Diagram (ERD)
An ERD visually represents the relationships between entities in a database. Here's what you need:
Entities:
Product: Represents items sold by the coffee shop.
Transaction: Represents a sale event.
Payment: Represents the payment method used for transactions.
BeanCard: Represents the loyalty or prepaid cards customers can use.
Attributes:
Product: Product ID, Name, Category (Beverages, Bakery goods), Price.
Transaction: Transaction ID, Date, Total Amount.
Payment: Payment ID, Type (Cash, Credit, BeanCard), Amount.
BeanCard: Card ID, Customer ID, Balance.
Relationships:
Products to Transactions: A transaction can include multiple products (many-to-many).
Transactions to Payment: A transaction is completed with a single payment method (one-to-one).
BeanCard to Payment: A BeanCard can be used for many payments…
arrow_forward
Draw an ER diagram to show the relationships among the tables
arrow_forward
Part C (Results):
For the results section, run the factorial ANOVA, Blocking, and ANCOVA analyses.
Copy and paste the results into your report, highlight any results you think are
important and add the following:
Compare the means if needed for the factorial ANOVA, add the graph,
results and interpret them,
Interpret randomised blocking results,
• Graphs for ANCOVA analysis.
arrow_forward
Computer Science
Design a tag management system for a company's products that supports the following features: users may create/delete/update tags, users may click on tags to get all related items to the tag, and users may retrieve the most popular tag on the platform. Please provide the REST API, Database Design/Schema, and Queries for this system design problem.
arrow_forward
explain this in nodejs management
arrow_forward
SEE MORE QUESTIONS
Recommended textbooks for you
Np Ms Office 365/Excel 2016 I Ntermed
Computer Science
ISBN:9781337508841
Author:Carey
Publisher:Cengage
Related Questions
- Big Data Processing One of the benefits from Graph Database is it is significantly faster than traditional RelationalDatabase System (RDBMS), especially for a database with many relations. Create a graph database of the following RDBMS tables with 3 records for each table. The Entity Relationship Diagram represents an Online Course Database. Use a graph diagram that consists of vertices and edges torepresents the graph database. Explain why a database query would be executed significantly faster in the Graph Database than the RDBMS based on the example database.arrow_forwardER Diagram You are working for DroneCore, a new startup that provides a backend for drone-based companies in towns and cities around the world. Your employer tasks you with designing a database for this service. Given the following information, draw the ER diagram: Any given startup should store information about Drones, Hubs, Employees, History entries, and Users. A Hub has an ID associated with it. A Drone has an ID, a model, a purchase date, and an assigned Hub, which it operates out of. Each Employee has an ID, a name, and a salary, and works at a specific Hub. Employees may also maintain a set of Drones. An employee can maintain any number of drones, but each drone must be maintained by exactly one employee. Each User has an ID, a name, and a preferred Hub. The company stores delivery History. A history item tracks a Drone's delivery to a User, and stores the departure time, the delivery number, time of arrival, and return time. This is MYSQLarrow_forwardBig Data Processing One of the benefits from Graph Database is it is significantly faster than traditional Relational Database System (RDBMS), especially for a database with many relations. Create a graph database of the following RDBMS tables with 3 records for each table. The Entity Relationship Diagram represents an Online Course Database. Use a graph diagram that consists of vertices and edges to represents the graph database. Explain why a database query would be executed significantly faster in the Graph Database than the RDBMS based on the example database.arrow_forward
- Cse topic cluster analysis Explain briefly how cluster analysis helps in analyzing the data objectsarrow_forwardMatch the scenarios given in the left-hand column with the type of decomposition indicated in the right-hand column. Arya is responsible for buying groceries and Asia is V [Choose] responsible for mowing the lawn Thread decomposition Task flow decomposition Weijun is responsible for cutting half of the vegetables and Zhihui is responsible for cutting the Data decomposition Data flow decomposition other half Task decomposition Jose is responsible for writing code and Yasmine is [ Choose ] responsible for testing the codearrow_forwardUsing Visual Paradigm design two diagrams one for the view layer and one for the data access layer like in the image for the "making a reservation through a web interface of a Car Sharing IS" Please do not use AIarrow_forward
- Data Structures (Code in Python) Create simple Restaurent Management System where Admin can Add, Delete items from linkedlist and Customer can order food and get bill.Admin functions:1 - Add items in menu (Linked List)2 - Delete items from menu (LinkedList) Customer functions:1 - Order items from menu2 - Calculate billarrow_forwardAttracted by the success of Spotify, a group of students want to build their own music-streaming website called Musicmatic. Being economists, they are unaware of the specificities of databases and have therefore asked you to create an EER model. A large number of songs will be made available through their website, and the following information on each song needs to be stored: title, year, length, and genre. Also, artist information will be added, including date of birth, name, and a URL to a website (e.g., Wikipedia page) with additional information on the artist. You can assume an artist is uniquely identified by her name, and that a song always belongs to exactly one artist. The Musicmatic students also point out that songs having the same title are possible, and only the combination of song and artist can be assumed to be unique. The database will also have to store information on the people using Musicmatic. It was decided to only discriminate between two types of users: regular…arrow_forwardDataBase case study: read this case study and finilize what should be the enitties that is mentioned in the case study and then make a ERD daigram of this data. Delhi Mart is a super Store located at Mahavir Enclave, New Delhi, India. Delhi Mart has many types of products that are related to specific Category. Delhi Mart are avail many different customers to sell their products daily. Every Category is managed by a particular manager. Customer order their selected product in terms of qty and avail selected discount on the product. Delhi Mart also have staff that manage different departments in the mall. Every Customer is concern with a particular staff to resolve their queries. Every Manager is responsible to maintain the stock if the stock will out they contact their selected supplier for buying products.arrow_forward
- Course : Database systemarrow_forwardHi please assist with a and b thanks Computer Science Question Datadyne inc. is a large company that has a system to manage its Data Warehouse. They would like to make some form or upgrade to the system that would enable them to streamline the way in which they perform operations as well as have a means to log which operations being done, and have been performed. One of your colleagues has suggested the following as suitable candidates for a Design Pattern to apply: Observer Design Pattern Object Pool Design Pattern Command Design Pattern (a) Which do you think is the most optimal design pattern? (b) Discuss why you think this is an appropriate design patternarrow_forwardA dimensional model is used in the building of a data warehouse, but what exactly does it do?arrow_forward
arrow_back_ios
SEE MORE QUESTIONS
arrow_forward_ios
Recommended textbooks for you
- Np Ms Office 365/Excel 2016 I NtermedComputer ScienceISBN:9781337508841Author:CareyPublisher:Cengage
Np Ms Office 365/Excel 2016 I Ntermed
Computer Science
ISBN:9781337508841
Author:Carey
Publisher:Cengage