Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
219 changes: 210 additions & 9 deletions content/published/dp700/book.yaml

Large diffs are not rendered by default.

557 changes: 549 additions & 8 deletions content/published/dp700/chapters/batch-data.md

Large diffs are not rendered by default.

322 changes: 314 additions & 8 deletions content/published/dp700/chapters/lifecycle-management.md

Large diffs are not rendered by default.

320 changes: 312 additions & 8 deletions content/published/dp700/chapters/loading-patterns.md

Large diffs are not rendered by default.

361 changes: 353 additions & 8 deletions content/published/dp700/chapters/monitor-items.md

Large diffs are not rendered by default.

489 changes: 481 additions & 8 deletions content/published/dp700/chapters/optimize-performance.md

Large diffs are not rendered by default.

389 changes: 381 additions & 8 deletions content/published/dp700/chapters/orchestration.md

Large diffs are not rendered by default.

431 changes: 423 additions & 8 deletions content/published/dp700/chapters/resolve-errors.md

Large diffs are not rendered by default.

485 changes: 477 additions & 8 deletions content/published/dp700/chapters/security-governance.md

Large diffs are not rendered by default.

462 changes: 454 additions & 8 deletions content/published/dp700/chapters/streaming-data.md

Large diffs are not rendered by default.

110 changes: 110 additions & 0 deletions content/published/dp700/chapters/workspace-settings.md
Original file line number Diff line number Diff line change
Expand Up @@ -213,6 +213,116 @@ A useful decision sequence is:

Current Microsoft Learn documentation states that Fabric Apache Airflow jobs do not support private networks or virtual networks. Treat that as a time-sensitive product limitation and recheck the authoritative source when designing a secured deployment.

## Troubleshooting and practice

<!-- block-id: spark-troubleshooting-lab -->
**Spark practice.** In a test workspace, record the default pool and whether item
customization is enabled. Attach an environment to a notebook, change its
runtime or pool, save without publishing, and predict which configuration the
next session will use. Publish and repeat. If publication fails, inspect runtime
and library compatibility; if a session starts with unexpected resources,
compare workspace default, environment publication state, attached environment,
and session-level configuration. Distinguish slow startup from slow execution:
starter-pool availability affects the former, while partitioning, shuffle,
skew, executor sizing, and capacity pressure affect the latter.

<!-- block-id: domain-troubleshooting-lab -->
**Domain practice.** Draw a tenant with Sales and Finance domains, one subdomain,
two default-domain groups, and an already assigned shared workspace. Predict the
workspace assignment after each administrator creates a new workspace. Then
verify who can assign each workspace and whether a consumer gains access. If an
assignment control is unavailable, check Fabric/domain role, workspace Admin,
the domain's allowed contributors, and tenant delegation. If catalog placement
is correct but access is denied, stop troubleshooting domains and inspect
workspace, item, and data permissions.

<!-- block-id: onelake-troubleshooting-lab -->
**OneLake practice.** Design a diagnostics destination and a lifecycle rule for
`Files/DiagnosticExports/`. Record capacity placement, configuring identity,
immutability period, path scope, age condition, tier action, and cleanup owner.
After enabling, allow for documented activation and asynchronous evaluation
instead of repeatedly toggling settings. For missing diagnostic events, check
destination prerequisites, permissions, activation time, and the requested
access route. For unexpected tiering, inspect default tier, explicit file tier,
rule scope, time basis, access-time tracking, minimum-retention cost, and the
policy's asynchronous run—not only the file's current modified timestamp.

<!-- block-id: airflow-troubleshooting-lab -->
**Airflow practice.** Given four concurrent DAGs, separate scheduler delay,
pool-resume delay, worker saturation, and slow task code. Compare starter versus
custom pool, node size, extra nodes, autoscale, and uptime ownership. Create a
decision record for an intermittent development workload and a production
workload with a start-time objective. If an Airflow environment uses an
unexpected pool, check the workspace default and whether item customization is
allowed. If tasks queue after the environment is running, examine worker
concurrency and task demand before increasing compute.

## Scenario drills

### Spark: one workload, different runtime

A workspace uses the starter pool and the default runtime for every job. One
machine-learning notebook needs a newer runtime, a published library, and more
executor memory. Other notebooks must remain unchanged. The workspace Admin
should first allow item-level compute customization, then the owner should
configure an environment with the required runtime, library, pool/resources,
save and publish it, and attach it to the notebook. Changing only `spark.conf`
does not select the environment runtime or driver/executor allocation.

The negative tests matter: confirm another notebook still inherits the workspace
default; confirm the target notebook fails predictably if the environment is
unpublished or incompatible; and confirm the scheduled identity can use the
environment and data. If all notebooks instead need the same change, revise the
workspace default rather than creating many identical overrides.

### Domain: discovery without accidental authorization

The organization wants all new Sales workspaces discoverable under Sales, with
Sales data stewards managing supported governance settings. Existing Finance
workspaces must not move, and catalog organization must not grant sales staff
access. Create a Sales domain, appoint the appropriate domain administrators and
contributors, configure a default domain scoped to Sales creators/groups, and
delegate only supported governance settings. Existing assigned workspaces remain
assigned; eligible unassigned and new workspaces follow the default mechanism.

Test catalog placement and authorization separately. A user who can find the
workspace through the domain should still fail to open its items without a
workspace/item/data grant. A contributor assigning a workspace must also
administer that workspace. This is the exam pattern: domains organize and
delegate; security controls authorize.

### OneLake: compliance logs and historical data

A compliance workspace needs access diagnostics protected from modification for
180 days. Curated tables are queried hourly, while exported evidence is rarely
read after 30 days. Select a same-capacity diagnostic lakehouse satisfying
network constraints; grant the configuring workspace Admin appropriate
destination access; enable diagnostics; and apply the documented immutability
window. Define privacy, reviewer, and cleanup ownership before protection begins.

Keep active curated data hot. Use a path-scoped lifecycle rule for eligible
evidence exports after modeling cool/cold minimum retention, access, transaction,
and early-deletion cost. Monitor activation and asynchronous lifecycle timing.
Diagnostics creates evidence, immutability protects it, lifecycle manages its
tier, and a later cleanup process removes it after legal retention. No one
setting performs all four jobs.

### Airflow: startup objective versus worker capacity

A production team needs DAGs to begin within a predictable window at 06:00 and
runs eight independent worker tasks. The managed starter pool is acceptable for
development but its availability and configuration do not meet the production
objective. Evaluate a custom pool whose active uptime covers the schedule,
choose node size from task demand, choose extra nodes from justified concurrent
workers, and use autoscaling only when variable demand warrants it. Assign an
owner for pause/resume, cost, and monitoring.

If the environment takes time to resume, adjust uptime/pool readiness. If it is
running but tasks wait, examine worker concurrency and task duration. If one task
is slow, fix or size for that task rather than adding workers. Finally, recheck
current network limitations from Microsoft Learn before assuming private/VNet
connectivity is supported.

## Exam distinctions

<!-- block-id: exam-distinctions -->
Expand Down
Loading
Loading