Free Databricks Certified Data Engineer Professional Exam Databricks-Certified-Professional-Data-Engineer Exam Practice Test

A Delta table of weather records is partitioned by date and has the below schema: date DATE, device_id INT, temp FLOAT, latitude FLOAT, longitude FLOATTo find all the records from within the Arctic Circle, you execute a query with the below filter: latitude > 66.3Which statement describes how the Delta engine identifies which files to load?

• All records are cached to an operational database and then the filter is applied
• The Parquet file footers are scanned for min and max statistics for the latitude column
• All records are cached to attached storage and then the filter is applied
• The Delta log is scanned for min and max statistics for the latitude column
• The Hive metastore is scanned for min and max statistics for the latitude column

The DevOps team has configured a production workload as a collection of notebooks scheduled to run daily using the Jobs Ul. A new data engineering hire is onboarding to the team and has requested access to one of these notebooks to review the production logic.What are the maximum notebook permissions that can be granted to the user without allowing accidental changes to production code or data?

• Can manage
• Can edit
• Can run
• Can Read

A CHECK constraint has been successfully added to the Delta table named activity_details using the following logic:A batch job is attempting to insert new records to the table, including a record where latitude = 45.50 and longitude = 212.67.Which statement describes the outcome of this batch insert?

• The write will fail when the violating record is reached; any records previously processed will be recorded to the target table.
• The write will fail completely because of the constraint violation and no records will be inserted into the target table.
• The write will insert all records except those that violate the table constraints; the violating records will be recorded to a quarantine table.
• The write will include all records in the target table; any violations will be indicated in the boolean column named valid_coordinates.
• The write will insert all records except those that violate the table constraints; the violating records will be reported in a warning log.

The data engineering team has configured a job to process customer requests to be forgotten (have their data deleted). All user data that needs to be deleted is stored in Delta Lake tables using default table settings.The team has decided to process all deletions from the previous week as a batch job at 1am each Sunday. The total duration of this job is less than one hour. Every Monday at 3am, a batch job executes a series of VACUUM commands on all Delta Lake tables throughout the organization.The compliance officer has recently learned about Delta Lake's time travel functionality. They are concerned that this might allow continued access to deleted data.Assuming all delete logic is correctly implemented, which statement correctly addresses this concern?

• Because the vacuum command permanently deletes all files containing deleted records, deleted records may be accessible with time travel for around 24 hours.
• Because the default data retention threshold is 24 hours, data files containing deleted records will be retained until the vacuum job is run the following day.
• Because Delta Lake time travel provides full access to the entire history of a table, deleted records can always be recreated by users with full admin privileges.
• Because Delta Lake's delete statements have ACID guarantees, deleted records will be permanently purged from all storage systems as soon as a delete job completes.
• Because the default data retention threshold is 7 days, data files containing deleted records will be retained until the vacuum job is run 8 days later.

Which statement describes integration testing?

• Validates interactions between subsystems of your application
• Requires an automated testing framework
• Requires manual intervention
• Validates an application use case
• Validates behavior of individual elements of your application

A Delta Lake table representing metadata about content from user has the following schema: Based on the above schema, which column is a good candidate for partitioning the Delta Table?

• Date
• Post_id
• User_id
• Post_time

The business reporting tem requires that data for their dashboards be updated every hour. The total processing time for the pipeline that extracts transforms and load the data for their pipeline runs in 10 minutes.Assuming normal operating conditions, which configuration will meet their service-level agreement requirements with the lowest cost?

• Schedule a jo to execute the pipeline once and hour on a dedicated interactive cluster.
• Schedule a Structured Streaming job with a trigger interval of 60 minutes.
• Schedule a job to execute the pipeline once hour on a new job cluster.
• Configure a job that executes every time new data lands in a given directory.

The data architect has mandated that all tables in the Lakehouse should be configured as external Delta Lake tables.Which approach will ensure that this requirement is met?

• Whenever a database is being created, make sure that the location keyword is used
• When configuring an external data warehouse for all table storage. leverage Databricks for all ELT.
• Whenever a table is being created, make sure that the location keyword is used.
• When tables are created, make sure that the external keyword is used in the create table statement.
• When the workspace is being configured, make sure that external cloud object storage has been mounted.

All records from an Apache Kafka producer are being ingested into a single Delta Lake table with the following schema:key BINARY, value BINARY, topic STRING, partition LONG, offset LONG, timestamp LONGThere are 5 unique topics being ingested. Only the "registration" topic contains Personal Identifiable Information (PII). The company wishes to restrict access to PII. The company also wishes to only retain records containing PII in this table for 14 days after initial ingestion. However, for non-PII information, it would like to retain these records indefinitely.Which of the following solutions meets the requirements?

• All data should be deleted biweekly; Delta Lake's time travel functionality should be leveraged to maintain a history of non-PII information.
• Data should be partitioned by the registration field, allowing ACLs and delete statements to be set for the PII directory.
• Because the value field is stored as binary data, this information is not considered PII and no special precautions should be taken.
• Separate object storage containers should be specified based on the partition field, allowing isolation at the storage level.
• Data should be partitioned by the topic field, allowing ACLs and delete statements to leverage partition boundaries.

A data engineer is testing a collection of mathematical functions, one of which calculates the area under a curve as described by another function.Which kind of the test does the above line exemplify?

• Integration
• Unit
• Manual
• functional