Glossary

Account – A user signed into a specific learning application. The account generally includes the user’s unique identifier on the application’s system. Both learners and instructors may have accounts.

Alignment – Instruction and assessment content assets are aligned when the instructional assets teach the exact same key ideas that are assessed by the assessment assets in the same Learning Objective.

Analytics – Actionable metrics that provide instructors, learners, and administrators with deeper insight to drive meaningful interventions. Typical Knewton analytics are backed by statistical models drawing on learner interactions with content, content metadata, and learning science research. Analytics may be calculated from data relating to particular assignments (e.g., Status & Progress) or entire student histories (e.g., Predicted Score), and they are typically designed for use at both the individual learner level and in the context of cohort or classroom-level aggregates.

API – Application Programming Interface. An API is a software interface between a client application and the server. The Knewton API is the software interface between a partner’s learning application and the Knewton platform.

Atoms – The minimal unit of content that can be distinguished when recording learner interactions. This is the smallest way a piece of content can be broken down and still make sense (e.g., a quiz could be broken down into questions, each of which would be an atom; a 15-minute video could be broken into three main segments, each of which would be an atom).

Bundles – A group of atoms that should be served together; also known as Containers (e.g. on the Content Inventory). For example, a bundle might be the set of instructional and assessment items in a lesson consisting of a sequence of videos and follow-up questions that is recommended as a whole, or a set of assessment items on a test.

Client ID – A unique identifier Knewton assigns to the partner’s learning application. The client ID is used in user authentication flows to identify the application.

Client Secret – A secret key assigned by Knewton to the partner’s learning application. The client secret is used in user authentication flows to verify the identity of the application.

Concept – A group of content assets aligned around a common learning outcome (aka learning objective). Knewton’s treatment of “concepts” is unique in that a Knewton concept is formally defined by content. The name and description of each concept must therefore be strictly reinforced by the parts of content that teach or assess that concept.

Confidence Interval – A range that indicates the set of values that are realistically possible for a given parameter. For instance, for a learner’s Expected Score on a goal, a 95% confidence interval of (.80, .90) means that Knewton’s models believe that 95% of the time, under normal conditions, the learner will receive a score between 80 and 90%.

Content Inventory – A complete listing of every piece of content in a learning application or book and their relevant metadata. Each piece of content should represent a single interaction between the learner and the application (e.g., a single assessment question or a single instructional lesson).

Content – Teaching or assessment materials included in a Knewton-powered course.

Discreteness – A course with discrete content is a course that has minimal “overlap” among concepts as well as minimal overlap among the content that is aligned to these concepts.

Entitlement – A set of permissions granted to a user account of Knewton’s API allowing the user to perform certain actions through API calls.

Expected Score (Deprecated) - A metric estimating a learner’s level of knowledge with respect to a specific assessment targeted by a goal. This metric answers the question, “What score would Knewton expect a particular learner to get on an assessment, in the form of a Knewton goal, if they took the assessment right now?” Expected score is reported over goals on a typical 0 to 1 scale and includes an estimate status which indicates whether there is sufficient data to calculate the value.

Event – A learner interaction within the learning application. Events inform Knewton’s generation of recommendations and analytics.

Goals – Objectives that define the scope of the partner application’s adaptivity. A goal could be an assignment with a few learning objectives due at the end of the end of a particular week, or a quiz assessing all of the skills worked on a given month. Every recommendation request in a Knewton-powered learning application must be in reference to a goal. See also Scoped Goals, Knewton’s preferred goal type.

Granularity – Refers to the sizes of the entities that describe the course, specifically Atoms and Concepts/Learning Objectives.

Informal data – Optional content or activity characteristics that may be worth recording, e.g., intended age alignments of content or expected time required for completion.

Integration (environment) – An API environment made available for the purposes of testing builds and prototypes of partner applications during the integration process.

Item – A subtype of module that has assessment value, i.e., can be answered correctly or incorrectly (such as a quiz question).

Knowledge Graph – A structured representation of the content in a course, as defined by a group of subject-matter experts. The knowledge graph is the subject matter experts’ best hypothesis about the important conceptual structures in a body of content. This hypothesis is used to inform initial recommendations and analytics. As Knewton gathers learner data, the hypothesis is refined, as are the recommendations and analytics that users see.

Learning Application (LA) – A partner’s software that delivers learning experiences. The learning application serves both instructional and assessment content.

Learning Instance – A grouping of users around a common piece of educational content collection. A section of a class, for example, is a learning instance.

Metadata Tags – A metadata marker used to annotate modules that share a feature not explicitly captured by the properties or relations of the graph.

Modularity – Modular courses contain units that can be delivered in a variety of orders, with the optimal order dependent on the individual’s needs.

Module – A single piece of content that Knewton can observe learners interacting with, e.g., a section of text, a question, or a video (see Atoms), or a group of such pieces of content that a learner should see togethet, e.g. an instructional video and two follow-up questions (see Bundles).

Point Estimate – A single value estimate of a particular metric. Many of Knewton’s statistical models produce probability distributions as outputs, and a point estimate is a particular percentile of such a distribution. In the context of analytics like Predicted Score, several point estimates may be requested at once, allowing the partner application to display a confidence interval drawn from the underlying distribution.

Postrequisite Concept – A concept that expects and assumes knowledge of content associated with its prerequisite concept. If concept A is prerequisite to concept B, then concept B is postrequisite to concept A.

Predicted Score - An analytic calculated over a learner’s full history designed to answer the question “What score would this student achieve on an exam given today, covering specific sets of learning objectives?” Predicted score combines the learner’s content interaction data with models of learning objective covariance and knowledge decay over time (“forgetting”), and it can return multiple point estimates of Knewton’s underlying probability distribution for the learner’s likely score (on a 0-1 scale) on an exam as a whole and/or groups of learning objectives covered by an exam.

Prerequisite – A relationship between two concepts that states a learning dependency of one concept on the other. Concept A is prerequisite to concept B if the content associated with concept B expects and assumes knowledge that exists in the content associated with concept A — and no other intermediate concepts transmits this knowledge along the way.

Properties (of modules) – Capture features of modules that are used by recommendations and/or analytics, e.g., the time the module was created.

Recommendable modules – In a goal, the set of modules that Knewton is permitted to recommend. In scoped goals, recommendable modules include target modules aligned to the goal-specified target learning objectives as well as modules aligned to any prerequisite learning objectives within the goal’s remediation depth.

Recommendation – An up-to-date listing of the next set of content that a learner should interact with, based on previous interactions.

Registration – A link between an account and a learning instance. An account may have many registrations at any given time.

Sandbox (environment) – An API environment made available for the purposes prototyping partner applications using a Knewton sample graph.

Scoped goal - Scoped goals are goals created by specifying target learning objectives, remediation depth, and completion criteria. Given these inputs, Knewton will realize a set of target and recommendable modules the learner may see when following recommendations on the goal. A variety of analytics are available over scoped goals, like Status & Progress.

Status & Progress - An analytic designed to return the current status and progress toward completion for a learner in the context of a scoped goal. The status indicates whether the learner’s goal is unstarted, in progress, or complete, or if the Knewton platform deems that the learner is currently struggling. Progress is value between 0 and 1 accounting for both what fraction of the goal’s minimum work requirements the learner has satisfied as well as the Knewton platform’s estimate of the learner’s current knowledge state.

System user – An administrator user account with “all” entitlements. A single system user is created by Knewton for every partner. The system user is typically used to provision key application resources like accounts, learning instances, and registrations.

Target modules – The set of modules used in a goal, which define the content a partner wants a student to master (as defined by the goal’s minimum predicted mastery). Also see “recommendable modules”. In scoped goals, target modules are determined by the alignment of modules specified in a knowledge graph to target learning objectives supplied at goal creation.

Target score – In a goal, the level of proficiency a partner wants a student to achieve on a set of target modules. For example, a target score of 0.7 means that the partner wants the student to reach a level of proficiency where they would be expected to get at least 70% of the target modules correct.

Target date — In a goal, the date by which a partner wants a student to reach a particular target score. The target date can be used to correspond to in-class test dates or other deadlines.

Taxon – A component of a larger taxonomy. Examples include a textbook structure, Common Core State Standard, or reading lexile levels.

Taxonomies – A hierarchical labeling a partner can apply to content. Taxonomies have relevance to the partner but are not intrinsic to Knewton’s models. Taxonomies are comprised of taxons.

(Access) Token – A short sequence of characters generated by the Knewton API and passed to the learning application as part of the authentication flow. Applications then use these tokens to securely and uniquely identify the user on whose behalf the API calls are made.

Volume – The amount of content available for Knewton to recommend. The Knewton system is designed to work with large volumes of content but can also adapt to situations where content is sparse.