Defence
Learning Analytics for Defence Education
Defence learning data sat across many platforms and reporting processes, which made enterprise-level analysis difficult. DMS developed prototype learning analytics dashboards, built the supporting data models and set out a roadmap for further work.
Prototype dashboards, supporting data models and a data-quality working group established the foundations for further learning analytics.
- Client
- Defence Learning Technologies, Australian Defence College
The challenge
Information about Defence learning sat across multiple platforms, organisational groups and reporting processes. Data was structured differently in each, and access was restricted, so questions about learning trends or program effectiveness across the enterprise were hard to answer.
Defence Learning Technologies engaged DMS to scope, design and build an initial learning analytics solution that works with online training platforms and with future Defence learning technology investments.
The approach
- Find out what exists before building. We ran an environmental scan of the learning data, platforms and reporting practices across the groups involved, so the design started from the real state of the data.
- Prototype with the people who will use it. We developed prototype dashboards with stakeholders and soft-launched them. Learning management system data is brought in with attention to accuracy and bias.
- Fix the data as well as the dashboards. We built the data models beneath the dashboards and set up a data-quality working group with the client, because a dashboard is only as good as the data behind it.
- Plan the next stage. We assessed longer-term analytics options to inform Defence's capability planning. The engagement pairs delivery with data literacy and skill development, so the client's own people build skills alongside the product.
The solution
An initial learning analytics product: dashboards shaped by stakeholder feedback, the data models that support them, data-quality practices and governance, and a roadmap for longer-term analytics capability. The planned work includes three dashboards, draft educational material and maintenance planning.
The outcome
Delivered foundations include the soft-launched prototype dashboards, supporting data models, environmental scan and data-quality working group. Longer-term capability planning remains part of the engagement.
Expected benefits: the planned analytics capability is intended to help Defence teams examine learning trends, learner performance and program effectiveness for planning and resource decisions. Adoption and productivity gains have not been established here.
Capabilities
- Learning analytics
- Data modelling
- Data governance
- Dashboard prototyping
- Analytics strategy
Learning data spread across platforms is a common place to start.
We scan what you have, prototype with your people, and build the data models and skills alongside the dashboards.