Contradictions in adjectives: You can't be consistent and optimal

One current challenge is attempting to engage productively with institutional strategic/operational planning. The big challenge in doing so is balancing the perceived importance of institutional level concerns (governance etc) with those of an individual teacher.

As part of this challenge I was reading a document summarising the aims of a rather large institutional project in ICT around learning and teaching. Yesterday I tweeted part of the strategies from that project (it starts with “Ensure the development of”

As my tweet suggests I see some contradictions in the adjectives.

Here’s a story from the dim dark past to illustrate how it’s essentially impossible to have an online student experience that is both consistent and optimal.

You shall not use single quotes!

Back in the mid-1990s CQU was a fairly traditional second generation distance education provider. As such it had a style guide for print-based materials (almost the only sort) that were distributed to students. In large part the aim of the style guide was to provide a consistent learning experience for students. One such element of the style guide was ‘You shall not use single quotes’. “Double quotes” were the only acceptable option.

So, that’s consistent.

Less than optimal

As it happens, in the mid-1990s I was the tutor in the course 85343, Machine Intelligence. The practical application of the concepts in this course were done in the Prolog programming language. Here’s a brief section of Prolog code taken from here. Can you see the problem this is going to cause in terms of consistency?

[code lang=”prolog”]
move(1,X,Y,_) :-
write(‘Move top disk from ‘),
write(X),
write(‘ to ‘),
write(Y),
nl.
[/code]

That’s write, Prolog code makes use of single quotes. The distance education study material for 85343 included sections of Prolog code. Do you know what the central distance education organisation did?

Obviously, because ‘You shall not use single quotes’ they automatically converted all of the single quotes into double quotes, printed the materials, and sent them out to students.

I don’t know whether the coordinator of the course got to proof the study material before it went out. But he was the Head of School and I’m willing to be if he did, he didn’t even think to check the style of quotes used in the Prolog code.

Consistent can’t be optimal

The lesson (for me at least) is that you can’t be consistent across all the courses in a university, while at the same stage claiming to provide an optimal learning experience for students.

This quote from Dede (2008) picks up on why this is a problem (or you can listen to the man himself)

Educational research strongly suggests that individual learning is as diverse and as complex as bonding, or certainly as eating. Yet theories of learning and philosophies about how to use ICT for instruction tend to treat learning like sleeping, as a simple activity relatively invariant across people, subject areas, and educational objectives. Current, widely used instructional technology applications have less variety in approach than a low-end fast-food restaurant. (p. 58)

And it’s not new

Here’s a quote from Jones (1996) – yep I had a bug in my bonnet about this almost 20 years ago and here I am again

With traditional on-campus teaching academics generally have complete control over what they teach and how it is presented. In CQU’s distance education model the subject matter’s presentation is controlled by DDCE. This results in significant tension between the desire to operate standardised systems for production and distribution of courseware and the desire for course designers to be creative and imaginative (Mark, 1990).

‘It’s like deja vu all over again’

There’s a paper or two here.

References

Dede, C. (2008). Theoretical perspectives influencing the use of information technology in teaching and learning. In J. Voogt & G. Knezek (Eds.), International Handbook of Information Technology in Primary and Secondary Education (pp. 43–62). New York: Springer.

20 Mark, M. The Differentiation of Institutional Structures. Contemporary Issues in American Distance Education, Michael Moore (ed), 1990, pp 30-43

Organising a change in session time

The next iteration of the ICT and Pedagogy course I teach is about to start. We’ve struck a small problem with one of the campuses, the person being employed to run sessions on that campus can’t make the scheduled time. I need to ask the students when would be the best time to reschedule the session. The following summarises how I’ll do this with Doodle and various other tools.

I’m posting this on my blog to share what I’ve learned about this task. Making this explicit illustrates to the folk in the course one way to make use of blogging. Share your learning, no matter how small or simple you may think it. It may also be of use to some of my colleagues at the institution. It’s also to help demonstrate a process of creatively combining ICT to help with an aspect of learning/teaching.

Two other important points the following illustrates

  1. The digital environment in which teachers (of all types) is littered with concrete lounges.
  2. How we live with those concrete lounges (how we do things with digital technologies) is going to be very different and dependent on our environment, skills, and the available tools (and the affordances we perceive).

    I don’t there are many people that would have completed this particular task the way I have.

The limitation of this example is that it is more a “classroom management” task, rather than a learning/teaching task. A learning/teaching task would involve the application of more pedagogical knowledge in the skills step.

The TEST framework

Over the last couple of years we’ve adopted/adapted Socol’s Toolbelt theory and TEST framework as a way of thinking about this sort of problem. Rachel – a past student – has a post that summarises some of the intent behind this approach.

In figuring out how to do this, I’m going to be thinking about the following

  1. Task – what needs to be done?
  2. Environment – where must this be done? What are the constraints?
  3. Skills – what do I know/have that can be applied to this task.
  4. Tools – what tools allow me (with my skills), in the environment I’m in, complete the task?

Task

Three main steps to this task

  1. Inform the students about the need for a change.
  2. Gather their responses about which time best suits.
  3. Inform them of the chosen time.

In a perfect world, step #2 should also perhaps include the ability for the students to see and perhaps talk about their responses and related factors.

Environment

This is a course being offered at the institution that employs me. There’s a Moodle course site to which the students are enrolled. There are also a few other related tools.

It’s still a week and a half from the start of semester. So no face-to-face discussions are possible as the students aren’t on campus yet (generally). There will also be the question as to whether the students are checking their institutional email accounts yet. Plus, I’m at another campus.

Skills

Probably the main relevant skill is some capability to use a range of digital technologies.

Tools

Moodle messaging

Moodle will be one. It should have some messaging capability that I can use to contact the students (though of course such contact will be limited to their institution email or any forwards they have set up). Can I find that tool and discover it’s affordances?

Nothing is obvious from the institutional Moodle interface. So fall back on Google “moodle messaging” (Of course, I if I wasn’t already aware of this feature and this particular term, I’d now officially be in trouble).

That Google search gets me to the Using Messaging page. It appears this is using Moodle “instant messaging”, not 100% clear that this will email the students. Ahh, the FAQ seems to suggest that messages are only sent as email when the individual have configured their preferences to have messages sent. I wonder whether this can be changed at the institutional level, and whether or not my institution has?

So, not a great fit due to the reliance on students being in Moodle. Can I get a list of student email addresses?

Student records

The institutional student records system does allow me to download a spreadsheet containing student data. The should have email address as part of it.

Ahh, no. Name, ID number, information about the grading basis for the course (which is all the same for all students at this institution and information I already know, why is that included), program, year level, citizenship status, and a column that contains the word “View Student Details”. On the web version this is a link to detailed information about the individual. In the spreadsheet, it’s just the word.

Now that’s real useful. An example of a concrete lounge if I ever saw one.

That spreadsheet seems to be designed as is, rather than for the purposes of teaching staff.

Moodle participants list

Okay, struggling now. Student email addresses are included in Moodle and visible through the participants lists to teacher. In theory you can choose which groups to view. The groups should include campus. Yes it does.

But it doesn’t look like I can download the list of participants to a spreadsheet, or easily extract the email address.

Ahh, and now the super slow response times from Moodle are commencing.

So, my solution is to copy and paste from the HTML page into a text file and use the following ed/vi command (sorry this is really, really nerdy) to extract just the email addresses.
[code lang=”sh”]
:.,$s/^.* ([^ ]*)@([^ ]*) .*$/1@2/
[/code]

I can then stick that list of addresses into my mail client and send an email.

Doodle

I used Doodle a couple of years ago. But I couldn’t remember the name. So a quick Google for “scheduling meeting” and hey presto, Doodle is the #1 hit I get back. There appear to be others, but I’ll stick with what I know.

Doodle is aimed at making the process of scheduling events easy. You can set up an online poll, send people the link, and they make their choice.

I could have done this with the Moodle quiz tool. However, Doodle is quicker to use and also I don’t have to add Doodle to the Moodle course site. This could cause some confusion as it’s only relevant to a subset of students, but also because doing so would break the design I’ve used on the course site.

Set up the quiz, time to send the email……there have been 6 responses since the poll was released yesterday afternoon.

How to help improve the Moodle book module

As mentioned in the last post there are limitations in the Moodle book module that are acting as a concrete lounge. The following documents an attempt to help improve the module.

In the end, I’ve made some serious steps to contributing a bit of code to a standard plugin (as I write this, I’m imagining how experienced Moodle folk will shudder at the many misuses of Moodle terms in the following).

Update: The “bug” in the Book module reported below is not a bug. There’s actually functionality in the Book module to support this, it’s just not obvious. More explanation is available.

Task and context

As described in the last post the context is a course website hosted in the Moodle LMS. A course that uses quite heavily the Moodle book module. The module has import function that is meant to allow you to import a collection of HTML documents into a book.

Concrete lounge

The problems with the import process include

  1. Titles for imported titles are 100% from the HTML filenames.
    e.g. call your file “Diigo tool disappears_sub.html” and the chapter title will be “Diigo tool disappears_sub.html”. Rather than “Diigo tool disappears”.
    The _sub is required by the import function to indicate a sub-chapter. The .html is to indicate a HTML file.
  2. The order of imported chapters is based on the order in the file system.
    e.g. If I have the following files to import
    [code lang=”sh”]
    dj:001 david$ ls *.html
    A blog.html
    Diigo tool disappears_sub.html
    Diigo.html
    The tools we’ll be using.html
    Twitter.html
    [/code]
    Regardless of the order in which I add these files to the zip file (import is via a zip file), the order that they will appear as chapters in the book is dependent on the order the file system of the Moodle computer creates.
    Even if I create the zip file in the right order
    [code lang=”sh”]
    dj:001 david$ unzip -t import.zip
    Archive: import.zip
    testing: The tools we’ll be using.html OK
    testing: Diigo.html OK
    testing: Diigo tool disappears_sub.html OK
    testing: A blog.html OK
    testing: Twitter.html OK
    No errors detected in compressed data of import.zip.
    [/code]
    The first chapter will be “A blog.html”
  3. There is not option to remove all existing chapters before import.
    There are situations where I’m trying to replace the entire book with the import. Currently I have to create a brand-new book resource, or manually remove all the chapters in the current book.
  4. No method for linking to a chapter prior to import.
    If I create the collection of chapters elsewhere, there will be times when I wish to create links between those chapters. Currently there is apparently no capacity to do this.

Bricolage

Here’s what I’ve done so far to address this problem with the resources available.

Process to make changes to Moodle core

This seems to be the process I need to follow for the above which translates into

  1. Is there a tracker issue?
    Via various trails I end up at the book page/section in tracker. Raising the question which versions of the book Module am I dealing with?
    Time to track through the book issues in tracker. Those related appear to be

    • support for re-importing chapters
      Close to what I’m working on. But it’s old. Created in 2008.
    • Book HTML zip incorrect URL
      Picks up on the issue with links between chapters that have been imported. This appears to have been fixed and should be in from 2.5 onwards. Need to check this (NOTE: I haven’t actually tried this process yet).

    Nothing apparent.

    So as a user I can report the bug/make a feature request and then contribute by making a fix. So let’s create an issue in tracker. What type of issue should it be?

    • bug – A problem which impairs or prevents the functions of the product.
    • improvement – An improvement or enhancement to an existing feature or task.

    Either could apply. I’ll be positive and call it an improvement. Issue created.

  2. Which branches should the fix be made on?
    The advice is

    Bugs should normally be fixed on all the supported stable branches that are affected. New features should just go into master, but sometimes minor enhancements are made on the most recent stable branch.

    So where does this fit? I assume a bug or minor enhancement. The other factor is that if I make this change on the version that my institution is using, that will increase the chances that I might get to use it this semester (which are very slim). Of course, it’s difficult to remember/discover which version of Moodle we’re using. I think perhaps 2.7 for now. Which seems to the other supported release.

  3. Develop the change using git
    Prior work contains an example of how to get a version of the Moodle source using git and start making changes. Will start with that.

    My issue number is MDL-49128

    The process I’ll use is

    • Fork the branch of Moodle I want to work on MOODLE_??_STABLE
      [code lang=”sh”]
      dj: david$ history | grep git
      git clone git://git.moodle.org/moodle.git
      git clone git://github.com/djplaner/moodle.git
      git branch -a # what are the available branches
      git remote add upstream git://git.moodle.org/moodle.git # connect upstream
      git checkout MOODLE_27_STABLE
      [/code]
    • Create the branch
      [code lang=”sh”]
      git checkout -b MDL-49128-book-import-fixes origin/master
      [/code]
    • Make changes – see below
    • Testing process
      • zipfiles.zip
        Has the following files that should be displayed in this order

        1. The tools we’ll be using.html
        2. Diigo.html
        3. Diigo tool disappears_sub.html (this is a sub chapter)
        4. A blog.html
        5. Twitter.html

        Without either fix the chapters will start with A blog.html, Diigo.html etc. through to Twitter.html.
        With the both fixes, the order of chapters should match the numbered list above. Also, the chapter names should not include .html or _sub

      • zipdirs.zip
        Has essentially the same chapters, however, they are implemented as folders containing a single HTML.
    • Commit the changes to my repo
      This wasn’t as straight forward as I thought. Ended up with
      [code lang=”sh”]
      git remote set-url origin https://github.com/djplaner/moodle.git
      git push origin MDL-49128-book-import-fixes
      [/code]
      Which ends up creating this nice little summary on github.
    • Ask the Moodle devleopers to review it
      Updated the issue in the tracker, time to wait and see what I got wrong.

Making changes

I’ve been using the zipfiles approach. A zip file with a collection of HTML files, each file equals one chapter. This is fixed based on previous work.

There is also a zipfolders approach. A zip file of folders. Where each folder equals one chapter.

The order fix is working on zip folders. However, with the chapter names, I’m now getting both the chapter name and the file name. So The tools well be using/The tools well be using. Should the filename or the folder name be used?

I’m assuming the folder name. The book module import code appears to support this. For example when reading HTML files it is looking for default files in the folders. i.e. Default.htm and index.htm. Suggesting that it isn’t assuming that these have the names of the chapters.

That appears to be working.

Factors

I have to think that anyone who had used the import function in action – like I tried to do – would have been aware of the limitations of the import function. It just doesn’t seem designed to be useful. Thus it seems logical to suspect that maybe the original designer wasn’t a user. They weren’t solving their own (or someone close to them) problem. Just implementing a feature. Hence they weren’t in a position to know how limited it was.

This distance between implementing the function and using the function seems to be a common feature of concrete lounges. Anyone who has to use a concrete lounge for any length of time is going to be aware of the pain and want to change it.

The fact that this particular bit of pain has stood for so long, has to say something. Perhaps it’s just at the book module is just an unloved child? But it is part of Moodle core now, so it has to be perceived to be useful for some.

Framing an open book as situated, social, distributed and protean

My institution has some grants available to produce open textbooks. The following is an attempt to develop an interesting idea that might be funded by such a grant.

This is a quick first run at this. It hasn’t been informed by any literature or other searches for prior art. It’s constrained by my experiences and perceptions. It’s crying out for suggestions and improvement. It could certainly benefit from a revisit to Putnam and Borko (2000) and similar.

Is it even a book?

After completing the following, the biggest question I have is whether or not what I’m talking about is a book? Answering that question effectively would seem important for the chances of being successful in a grant application.

Perhaps why I think this is a book stems from the design of the course I teach. Each week has a learning path that the students will use as their initial foray into the wilds of the particular topic. They work through the learning path as if it were a multimedia book. Working sequentially through a sequence of pages. Those pages contain a bit of text, embedded video and other multimedia, and various activities and exercises.

The learning paths are situated in the Moodle LMS, so it doesn’t look explicitly like a book in the way that Project Management for Instructional Designers does. But that’s more a question of interface, than interaction.

Is that a valid/convincing argument?

Reservations about open textbooks

I have some reservations about the idea of funding academics to produce open textbooks.

As the tweet suggests, it strikes me as somewhat old fashioned. There’s thing called a World-Wide Web that has hypertext and multimedia capabilities that extend far beyond the capabilities of a “book”. Plus it’s taken off in a fairly big way and there’s an awful lot of good information out there. Is a “book” all that interesting, innovative and useful?

@s_palm and I seemed to agree at around the same time, that there are some more interesting possibilities.

The following is an attempt to expand on what might be interesting, useful and perhaps innovative.

Start with a conception of learning and knowledge

If the aim is to produce something to help people learn, it would seem sensible to consider at some stage conceptions of learning and knowledge. I’m going to draw on the “distributive view of learning and knowledge” that we used in this paper (this view has become my most recent hammer). It’s based on three themes from Putnam and Borko (2000), plus one we’ve added

That conception sees learning and knowledge as

  1. Situated in particular physical and social contexts.
  2. Social in nature.
  3. Distributed across the individual, other persons and tools.
  4. Digital technologies are protean.
    It’s pretty clear which one of the four we’ve bolted on, just from the summaries. As it’s currently framed, this one doesn’t fit nicely. It’s also more than just digital technologies, learning and knowledge are protean (tending or able to change frequently or easily; able to do many different things; versatile).

An open “book” with a distributive view

The following uses those four themes to think about what an open “book” might look like if this distributive view of learning and knowledge is used. It’s going to focus explicitly on the main course that I teach – ICT and Pedagogy. A 3rd year course for pre-service teachers aimed at developing their capability to integrate the use of digital technologies into their teaching.

The aim of any grant application would be to start developing the practices and tools that enable the production and support of an open “book” that supports some of these. I do have a question about whether or not such a “book” is in danger of just becoming an online course of some description?

Situated

A good “book” would be situated in the different contexts within the course. What are those contexts and how might a “book” be situated?

  • Learner’s learning environment.
    The environment in which learners learn is incredibly diverse on many characteristics (devices used, their PLE, time, location, etc.). So format of the book, the devices used to read and contribute to it should be flexible.
  • Course environment.
    The abstraction of the course is still core at universities. Each course has its website and specific rules, nature and timing. The situated nature of knowledge and learning provides some arguments about why each course should be different. An open “book” should support that.
  • Other course environments.
    It should also support the ability to move into other course environments. The difficulty of doing this is perhaps one reason most university courses remain silos unto themselves. The book should be visible to other courses/teachers, it should be easily customisable to the needs of different courses, and yet retain the ability to share changes between courses.
  • Teachers’ teaching environment.
    Just a learner’s learning environment is different from others. So to a teacher’s teaching environment. More specifically how they go about “authoring” and curating a “book”. Teacher’s shouldn’t have to under-go massive change to contribute. It should start from their current environment and work out.
  • Learner’s professional environment.
    Learner’s in my course range from early childhood educators right through to VET educators. There are a number of professional environments with which they must engage (e.g. the Australian Curriculum). The “book” should integrate with these professional environments. For example, have a simple way to integrate links and content like a content descriptor from the curriculum.

    This also points to the book containing “authentic activities and resources”. Dealing with issues and knowledge that are meaningful to them.

  • External environment.
    In part this is the “open” nature. Anyone should be able to access it from their environment. Hopefully it’s something students continue to draw upon and contribute to for the rest of their professional lives.
  • Institutional environment.
    Sadly, institutions have policies, systems and other constraints on how and what can be done. Will need to be cognisant of those. In my context, this means linking in and working with the Moodle LMS.

Social

Authoring and reading a book are typically very individual tasks. There are views of learning that see it as arising from social interaction. From engaging with and becoming familiar with how specific communities think and act.

Some ideas from this view include

  1. Support for multiple authors and versions.
    Not only should I not be the sole author, there should be active support for people to “fork” their own version of the book (or parts thereof). The influence of Smallest Federated Wiki here. Both learners and other teachers.
  2. Capture the residue of the communities experiences.
    The experiences, actions, and creations of the people “reading” the “book” are able to be captured and used to enhance the “book”. This post gives an example of this and some of its origins in the learning communities literature.

    Examples might include

    • the idea of learners forking off and changing versions of the book;
    • the capturing of annotations (as shown in the blog post
    • sharing prior answers to exercises provided by learners as examples.

Distributed

The big idea here is that cognition is just not in the head of the learner. Instead, it’s a function of the individual, other people, and the tools/environment they have to work with.

In terms of learning, there seems to be an obvious connection to mindtools defined by Jonassen (2000) as

computer-based tools and learning environments that have been adapted or developed to function as intellectual partners with the learner in order to engage and facilitate critical thinking and higher-order learning (p. 9)

Kirschner & Wopereis (2003) extend this a little to “include the facilitation of work (by knowledge workers)” (p. 110) and argue that “(Aspirant) teachers must therefore learn how to use mindtools both as a means of encouraging constructive learning in the classroom and as a tool for their own professional growth” (p. 110). Jonassen (2000) describes 5 characteristics of mindtools that connect nicely with these themes and could be useful.

The particular “mindtool” I have in mind for here is a unit planning tool. My course (and its “book”) currently asks learners to develop a unit plan to demonstrate their capability of designing the integration of ICTs into their teaching. Currently this is supported by a unit plan Word template. It does not contribute a lot of cognition to the task.

The rough idea is to develop a unit planning “mindtool” as part of the book, that would

  1. be used by learners to develop a unit plan;
  2. provide direct connections to parts of the book explaining each section of the unit planning process;
  3. provide access to relevant examples based on the learning objectives chosen for the unit plan;
  4. provide checklists and suggestions for what to do next;
  5. provide access to examples that have been critiqued;
  6. be integrated with curriculum where possible; and,
    e.g. if you specify the unit is for Year 7 Mathematics in a Queensland school, then the only learning objectives you can choose from are taken from the appropriate curriculum. The only criteria you can use in a rubric, are from the appropriate curriculum.
  7. track coverage of learning objectives in learning experiences.

Another possibility from the “distributed” perspective is that the “book” doesn’t reside on one specific server. It is instead distributed across many different locations, courses etc.

Perhaps more importantly is that the implementation of the book should not require the adoption of a single authoring process or presentation tool. The aim is not to develop the one-ring to rule them all, but to enable the building of a network of tools that can contribute to the book. Which tools are used, depends on the situations of the learners, authors, teachers, readers. Picking up on some points made in another discussion about “books”

Protean

In short, the idea is that anyone and everyone can change the book. In fact, the aim would be to explore if and how some aspects of change can be automatically enshrined into the book. This also links to the social perspective above.

References

Jonassen, D.H. (2000) Computers as Mindtools for Schools: engaging critical thinking, 2nd Edn. Upper Saddle River: Prentice Hall

Kirschner, P., & Wopereis, I. G. J. H. (2003). Mindtools for teacher communities: a European perspective. Technology, Pedagogy and Education, 12(February 2015), 105–124. doi:10.1080/14759390300200148

Putnam, R. T., & Borko, H. (2000). What do new views of knowledge and thinking have to say about research on teacher learning? Educational Researcher, 4-15.

Kludging an authoring process with Moodle books (almost)

The following outlines an attempt to evolve the authoring “process” I currently use with Moodle books into something a little more useful. It won’t be the be all and end all of authoring process, just enough to solve the immediate problem I have. i.e. bricolage

I’ve essentially got this working on my end. The problem is that the Moodle book module has a few flaws in how its import function works which means I can’t really use this approach. At least until the book module is fixed. I’ve fixed most of it on my own install of Moodle. Will have to find out how that might happen.

Some related work

As it happens @abelardopardo wrote a post yesterday titled Re-visiting authoring: Reauthoring that touches on the broader problem and offers a solution. Many of the conditions he outlines align with mine, however, my need is more immediate and contextual than what would be need to explore and adopt his solution.

And I remember @timklapdor doing some work around this broader issue last year. Yep, I even commented on his post. A comment that captures some of my disquiet about institutional approaches to solving the authoring problem (I know my institution will be having another go at this soon).

Meaning I’m not trying to solve it at the institutional level. I’m simply aiming to enhance my current practice a bit. An “inside out” approach, rather than outside in.

A better idea

If I had the time I might have modified the approach below so that rather than exporting the Moodle book into HTML files on my computer, I’d have it exporting to pages on my smallest federated wiki (SFW) (and back into the Moodle book). With this approach the SFW version would be the definitive version. It has version control built in at the paragraph level and opens up a range of possibilities of students (and others) being able to fork and work on their own versions of the content. An affordance that could potentially be much more interesting from a learning perspective and in terms of being “open”.

However, the SFW authoring environment doesn’t feel quite as natural to what I plan to use below. That may simply be familiarity, but there’s also the problem that SFW somewhat denigrates the use of HTML and is somewhat limited in terms of presentation and embedding. Why not use SFW, rather than Moodle books? Mainly because the course design currently (and perhaps problematically) relies on Moodle activity completion. Not a function that is available in SFW, nor a function that is sensible in the SFW world-view. It also appears – after a quick test – that SFW doesn’t necessarily play all that nicely with search engines. Meaning that SFW doesn’t solve my big bug bear with Moodle, no search capability.

Deja vu all over again: why?

I do this with some reservation due to a sense of deja vu. Almost 20 years ago as I prepared my first totally web-based course I wrote a set of scripts to help with authoring the web-based study material (thank you the web archive). Tools and an outcome not unlike the approach I’m working toward below and not that far removed (but far more primitive) than those mentioned above.

Why? Why after 20 years this authoring problem still hasn’t been solved? Why do there remain a plethora of disjointed systems and no-one really good solution?

Perhaps mainly because there is a plethora of disjointed systems in which the resources that are authored have to fit. Each of those disjointed systems have different world-views and subsequently sets of functionality. Hence it’s almost impossible for one authoring process to fit nicely into all of them. e.g. the talk above about integrating SFW and Moodle books. Adding more complexity, and touching on the comment I made on @timklapdor’s post, the people who are likely to use, the people that will use these authoring systems come with their own set of world-views, preferences and peccadilloes. The gaps between all these world-views are perhaps just big enough to prevent the wide acceptance of a single approach.

Suggesting that designing or selecting a single system (an outside-in approach) for everyone to use is destined to fail. There will always be gaps between the different world-views. Even if you can get everyone to agree, in a year or so another type of system will arise and there will be another gap to overcome. Perhaps a better approach is focus on what people are currently doing and bridge the gaps (an inside-out approach), which is sort of what I’m doing here.

The problem and context

As outlined in a previous post and shown in the following screenshot my course uses “Moodle books”. Each Moodle book tends to be focused on a specific task and generally is wrapped around external resources.

Week1

These books were originally written in HTML using the vi editor and manually imported into Moodle. Last year I made ad hoc changes by using the book module’s “editing” interface. That’s not a great process.

The wish list for what I want from a process

  1. Have an authoritative source HTML file that contains all the content for the book.
  2. Use directories and files to create a structure that mirrors the learning paths on Moodle.
  3. Perhaps in way that allows the content to be put on another website so it can be searched.
  4. Have that structure under source control.
  5. Allow simple updating of the Moodle book.
  6. Benefit from the Moodle migration smarts.
    The Moodle books point to additional Moodle activities (e.g. quizzes, discussion forums) etc that are used in learning activities in the books. When a new offering of the course is prepared, the old offering is migrated. This migration process is smart enough to have the books in the new offering pointing to the activities that belong to the new offering. The “books” in source control wouldn’t be automatically updated this way.

In essence, I’d like to edit the books using vi (or whatever HTML editor etc I end up using) on my local computer. When I’m happy with the book, commit it to source control and import it into Moodle.

In a perfect world, at the start of a new term I’d have a process that dumps the migrated books from the new course site onto my local computer ready for editing and importing into source control.

Exploration and Development

The following documents some exploration of various possibilities that might help achieve the above.

Import and export from a Moodle book

When I started all this either I was aware of, or the Moodle books didn’t have an import facility. Time to play with that as it may be the foundation for putting content back into Moodle quickly.

It appears it accepts each chapter as a HTML file. Which is a bit of a bugger as I’d hoped to work with a single HTML file locally and upload that. Appears I may need some sort of script to produce the format required by the Moodle book. Let’s test this out

  1. Download an existing book.

    I’m doing this by using the “print book” function. This produces a fairly bare HTML file of the entire book that forms the basis for the local copy.

  2. Look at the HTML.
    Diigo/Firefox has stuck a bunch of css etc into it. Remove that.

    • book_summary/title
      classes book_summary and book_info use for entire book information.
    • class book_toc_numbered
    • Chapters are surrounded by a div with class book_chapter, heading 2 used for the title.
    • Sadly sub_chapters also appear to use class book_chapter but with heading 3
    • A collection text/css files are created when saving the printed file.
  3. Import that single HTML file into another book.
    Well that doesn’t work. Apparently an invalid file type. Let’s try removing all the diigo etc crud. Nope that doesn’t help.
    So what about a single section of HTML?
    Of course, it has to be a zip file that you upload. Idiot. So zip file with two html files. One the big HTML from the book itself, and the second a small excerpt.
    So it does the import and presents some feedback – “Importing” “Relinking” and then a continue button.

    Appears to be a very simple import. Each HTML is create as a single chapter. Sequenced in the order found in the zip file.

    What if I import again, but change one of the files to end in _sub.html. This is meant to create a sub chapter. That works as expected. Another two chapters added to the book, exactly the same as the other two. But the test_sub.html has been created as a sub-chapter. i.e. the title of the chapter is taken from the title, but it isn’t smart enough to remove the _sub, even though it knows what _sub at the end indicates. Note: I really should do something about that, looks like it would only take the addition of a single line of code.

  4. Look at the content and develop the script.
    Looks like the script will need to parse the HTML “print” version from the book by

    • Extract all the div class book_chapter
    • for all of those (in order that they are found in the HTML file)
      • create a new file with the following name format NUMBER TITLE{_sub}.html
        1. NUMBER – A number such as 001 to ensure that the order stays the same.
        2. TITLE – the title from the heading 2 or three immediately inside the div.
        3. _sub – if it’s a heading 3 – indicating a sub-chapter.
      • Add in the content of the div into that.

    Also appears like I’ll need to have two separate functions, related to preparing the version of the file to

    1. edit; and
      This would be a single HTML file that I use to edit.
    2. import.
      The one outlined above that would imported into Moodle.

    So which Perl HTML parsing module to use? TreeBuilder::XPath was the most recent I’ve used. But I’m doing jquery a bit recently, so Mojo::DOM is interesting.

    Yep that worked. Script is now producing an EDIT.html file that I’ll use to make changes.

  5. Import the broken up HTML files into another book
    The aim here is to

    1. extract all the book sections from the EDIT.html file
    2. create a collection of separate HTML files containing the contents of each book section
    3. zip up all those separate HTML files ready for importation
    4. remove the files

    Done. Fairly simply. Tried import into the book and it’s sort of worked. The problems to solve are

    1. The inclusion of “.html” in the chapter name.
    2. The inclusion of “_sub” in the chapter name.
      These first two problems appear to be down to how the Moodle book import function works. i.e. it doesn’t remove these, which is somewhat surprising. Have made some initial changes to my local Moodle installation (about line 83 of mod/book/tool/importhtml/locallib.php), but which won’t work on all uses of the module – e.g sub-directories, HTML files with .htm extensions etc.
      [code lang=”php”]
      # DJ’s changes
      if ( preg_match( "/.html$/", $chapter->title ) ) {
      $chapter->title = preg_replace( "/.html$/", "", $chapter->title );
      } # end DJ’s changes

      if (preg_match(‘/_sub(/|.htm)/i’, $chapter->importsrc)) { // If filename or directory ends with *_sub treat as subchapters
      # DJ’s changes
      // remove _sub from title, should be last given above replacement
      if ( preg_match( "/_sub$/", $chapter->title ) ) {
      $chapter->title = preg_replace( "/_sub$/", "", $chapter->title );
      } # end DJ’s changes
      [/code]

    3. The inclusion of #39; (i.e. html entities) in the chapter name.
      This appears to be due to the process I’m using to save and process the exported book files. I need to modify it to decode HTML entities. Easy enough in Perl using HTML::Entities. But I also have to update the heading back in the HTML. Done.
    4. Chapters having no content.
      My immediate guess is that the HTML files being imported still have some of the Moodle book divs etc and that this is clashing. So remove those and test. Nope, that didn’t work. Time to look at the code
      [code lang=”php”]
      if (preg_match(‘/<body[^>]*>(.+)</body>/is’, $html, $matches)) {
      return $matches[1];
      [/code]
      Oh dear, regular expression matching. That’s the problem. It requires a body tag around the outside. Have to love open source projects where you can look at the code. That’s fixed.
    5. Duplicate headings.
      The import file needs to have the heading title and the other book chapter remnants removed to prevent issues. Done.
    6. The chapter numbers still present.
      The Moodle book import processes the collection of files in the order it sees them in the zip file. To make sure that the order is what I want, the filenames start with numbers. The problem is that the import process doesn’t remove the numbers, so you end up with stuff like 2 2 Diigo where the first 2 is from the Moodle book module and the 2nd 2 is from the file name.
      I can’t change the Moodle book module code quickly enough to help me.
      Can’t remove the numbers in my export script as this would change the order of the files imported.
      Leaving exploring the zip function to see if I can specify the order the files should be zipped in the script, without relying on numbers in the file system. Can do this with zip, however, the book module doesn’t play nicely. It looks like it just unzips the file, forgets about any order in the zip file and relies on the order from the file system.
  6. Additional problems
    Of course it’s not going to be as simple as this. A major problem will be that via this process I will lose the capability to correctly link between pages in a book. The import process back into the Moodle book will either actively change links to a Moodle book, or it will ignore them.
    It will also play silly buggers with links to/from other Moodle books. i.e. modifying a book this way will break all other links to the original version of the book.

    Some possible solutions

    1. Have the import script look for and announce links to Moodle books.
      Thereby allowing for manual intervention.
    2. Run the institutional “check course” function to check for broken links
    3. Modify the book module so that the import function supports some sort of variable for pages.
      i.e. the ability to use {TITLE_OF_PAGE} as a link to a page within the current book. Where TITLE_OF_PAGE is the chapter title.

Export all Moodle books

This will have to wait until another day.

A structure that works

Looks like being something like

  • Week folder
    • Book folder
      • ALL.html – the version imported from Moodle.
      • EDIT.html – output of “parseBook.pl ALL.html” ready to edit.
      • IMPORT.zip – output of parseBook.pl. A zip file ready to import into Moodle that contains ALL.html split up into the appropriate separate HTML files.

git{hub}

Wait for another day. But I assume the aim would be to have EDIT.html in git with the surrounding structure.

Planned process

  1. Create a folder for each week.
  2. In that create a folder for each book using 001 etc to get order correct
  3. Save a HTML version of the book from Moodle into EXPORT.html in that directory
  4. Run the script which will produce an EDIT.html file in that directory
  5. Make the changes in the EDIT.html file
  6. The EDIT.html file can be kept in github?
  7. Run the script to produce the import version.

To do

  • Look into how to suggest/contribute the following changes to the Moodle book
    • Modify the chapter titles imported to remove the _sub and the .html.
      Semi-done.
    • Import chapters in the order they are contained in the zip file (if possible)
      The zip stuff is done by lib/filestorage/zip_packer.php. ATM, the book module is simply extracting files to storage. Hence the problem with out of order. zip_packer does have a list_files method that might just provide the list of in order file names that we’re after. This actually works and the book module does use this initially to get the filenames. But it loses the order when it creates a hash with the pathName as the key.

      That’s fixed.

    • Have an option to remove all existing chapters prior to import.
  • Think about the implications of integrating SFW .

Metaphors and organisational change

Metaphors are useful. They reveal some of the underlying assumptions held by people. For example, this paper (Behrens, 2007) reveals that Information Systems research has a strong bias towards thinking of organisations as if they were machines. A bias that tends to invade most organisational practice. The following picks up on a couple of recent events to examine one of the metaphors commonly used in academia. It argues that this metaphor reveals some problematic assumptions.

Herding cats

The standard trope around academics and change is herding cats. Captured memorably by an EDS commercial

Of course, anyone who knows cats, knows that’s not the way to get cats to do anything.

Update: (26/06/2015) Apparently the Mythbusters have some empirical proof of how difficult this might be. As pointed to by this tweet

Obviously this difficulty was foresee by others, as (end update) is illustrated by a tweet yesterday from @SAlexander_UTS summarising a point made by a senior academic

Even this modification of the herding cats metaphor doesn’t understand that the entire metaphor is based on potentially problematic assumptions. Problematic assumptions that I have observed failing to have any impact on universities for something approaching 20 years.

I’ll focus on three.

That you know where to move the food to

The first assumption is that someone (typically senior management) know where to move the food. i.e. someone knows what is the best strategy, the best practice. This is the assumption that underpinned Mao’s four pests campaign to eliminate rats, flies, mosquitoes and sparrows. The sparrows ate grain meant for the people, so had to go. They were eliminated by (amongst other measures) millions of villagers heading out to bang pots and pans to continually scare sparrows so they would never land and hence die from exhaustion. The campaign was so successful that there was a locust plague.

Apparently, the sparrows also ate insects, including locusts. With most of the sparrows dead, the locusts bred leading to somewhat troubling and unintended consequences.

Change of a complex adaptive system – like a university/organisation – is very very difficult because it’s difficult for a group of people (even if they are super intelligent senior management) to understand all of the consequences of changing where the food is located.

That you can successfully move the food

Be Water Wise

The other assumption underpinning the herding cats metaphor is that you can successfully move the cat food (or herd the cats). i.e. once you’ve identified where to move the cat food to, that you are capable of picking up the cat food and moving it to the new location. At an organisational level this is very hard for any meaningful change.

For example, over the last two days I was attending a planning session for the two schools of education at my current institution (I work in one of those schools). The sessions were held in the dining room of one of the colleges on-campus. The restroom for men at this college provides a wonderful metaphor for just how difficult it is to move the cat food and illustrates what “moving the cat food” typically looks like in most universities.

As the image shows, the door into the restroom had prominently displayed a sticker promoting the idea of being water wise. Someone in the college or broader institution had identified being water wise as a good idea and was trying to herd the cats in that direction.

The only trouble is that when you entered the restroom you soon became aware of running water. As the next image shows it appears that the washer in the basin tap was shot so that tap was continually leaking. No matter how water wise I wanted to be….

Running water

When it comes to “moving the cat food” in universities. It often more closely resembles the distribution of lots of stickers, rather than effectively modifying the environment to achieve the stated goal. So an institution that is keen on Open Educational Resources runs lots of special events and creates websites espousing the benefits of open educational resources. But at the same time retains a default position that the copyright for all teaching materials created by staff remains with the university. If I want to convert my teaching resources into open educational resources, I have to ask the legal office for permission.

That the cats will follow the food

So, assuming that you can

  1. Identify the best destination for the cat food; and,
  2. Successfully move the cat food to that destination.

The assumption is that the cats will follow the food. That they will happily accept your arbitrary decision that they should eat in a new location.

Anyone who knows cats, knows that this isn’t going to work. For example.

If there is a defining characteristic of cats it is that they have a fairly high level of agency. They will decide whether or not the new destination suits. If it doesn’t, they will do something else.

For example, if you design a new standard look and feel for the institutional LMS and it is a step backwards in terms of functionality, then some academics will work around that look and feel.

It’s called task corruption.

Other alternatives

I’m a cat person (I’m also a dog person) and based on my experience there are other alternatives.

Scruff of the neck

You could take a leaf out of the species textbook and grab them by the scruff of the neck and take them where you want. This is an approach that is being taken by some management. However, it still suffers from exactly the same problems as outlined above.

Beyond those problems, it adds the additional problem of changing the relationship between you and any adult cat you try this with. Especially if you try it repeatedly.

Squirting water

If wanted the cat to stop doing the wrong thing, you could always use the squirt bottle approach. Whenever the cat does the wrong thing, you squirt water at or yell loudly or some other form of punishment.

Of course, this actually can only ever prevent the cat from doing the wrong thing, rather than take them to a new place. It also assumes you can identify the “wrong thing” to do.

But worse than that, there is an argument that it doesn’t even work and I quote

The squirt bottle technique only accomplishes three things:

  1. It creates frustration in the cat
  2. It causes the cat to become afraid of you
  3. The cat learns to wait until you aren’t around before engaging in the behavior

Trust

Winter in Toowoomba

This is Tommy (aka Son). He’s my cat/I’m his human. We’ve been together for must be almost 9 years now. Tommy can be the other side of the yard, but if I make a particular noise (and all things being equal) he will generally head my way (at his own speed). He knows that there will be a positive outcome and generally desires that outcome. He trusts me. If something in the environment changes (e.g. visitors) he may not, but in the right circumstances I might be able to get him to surface, but there are limits.

This is another approach you can take with cats. However, it still suffers from the same problems as above. It assumes that I (senior management) know where to go and can successfully get everyone there.

Surprise – let the cat(s) take you where it will

An approach that doesn’t seem to be all that much discussed is to let the cats be cats. Enjoy what they do and what they will give you. Perhaps establish a few routines and the appropriate environment, but the reason anyone owns a cat is because cats surprise and give enjoyment. Letting cats be cats.

Just a bit like organising a children’s birthday party.

Concrete lounge #1 – Helping learners find correct, up-to-date course information

The following is (hopefully) the first in a growing list of concrete lounges that I’ve faced in institutional e-learning. The concrete lounge metaphor is my attempt to explore the reality of university e-learning, to illustrate some possible reasons why it continues to be so wrong, and see what can be done to address those reasons.

The other main reason for sharing what I’m doing. Perhaps some of this might be useful to other, but more importantly I’m hoping to find out what others have done/think and thereby discover better ways to live with the concrete lounges that institutions are providing for learning and teaching.

The following covers

  1. Task – what learning/teaching task am I struggling with.
  2. Context – within which I’m struggling.
  3. Concrete lounge – a list of the tools provided by the institution to fulfill this task – including:
    • No search engine
    • Topic-based sites and course-wide information
    • Scroll of death
    • Keeping information up to date
  4. Bricolage – the tinkering and kludges I’ve put in place to live with the concrete lounges.
  5. Factors – some random, incomplete thoughts about what is behind all this.

Task

The task this post focuses on is

Helping learners find correct, up-to-date course information

Information such as what they should be doing each week, what is the assesment, when is it due etc. Both learning and administrative information. If students can’t find this information it impacts their learning.

There are suggestions that finding such information at my current institution is a concern that has driven some institutional practices.

Context

I have complete this task in the following context.

A 3rd year course taken by all Bachelor of Education students. A course that is offered twice a year. S1 offering with around 300 students both on-campus and online (150+). The S2 offering with around 100 students all online.

The course breaks the semester up into four modules. Each module consisting of a number of weeks as shown by the study schedule below.

studySchedule

Moodle as the LMS. Each topic on the course home page equates to a week of semester. Each week consists of a “learning path”. i.e. a list of basic activities and resources that are designed to get the students started in their learning. The following image shows the learning path for week 1.

Week1

Each learning path makes use of the Moodle book plugin (look for the green book like icons next to elements in the above image) to guide students through the learning path. Each Moodle book tends to be focused on a specific task and generally is wrapped around external resources. For example, the “Toolbelt Theory” book in the above prepares the students to read this post and engage in a number of activities. Including the use of Diigo to share thoughts on the post with others in the course).

Concrete Lounge

The following identifies the limitations and problems that arise from the technologies provided by the institution. Some of these problems are huge barriers, some require a bit of creative tinkering that may or may not be immediately visible to many folk.

There is no search engine

Even though I don’t provide a lot of information in the Moodle books mentioned above. There still remains a fair bit of information that is provided on the course.

Moodle – as installed at my institution – does not provide a search engine!!!

This is the standard mechanism for finding information on the web. Students can’t use it on a course site.

Topic-based Moodle course sites and general information

A Moodle course home page can only use a given list of formats. The most common formats are to structure the course either by topic or week. Essentially a sequence of topics/weeks each containing a collection of activities/resources related to that topic/week.

This raises the question of where to put activities/resources that are important to the course, but are not specific to a particular topic/week. In my course such information includes: the study schedule overview, assessment information, information about the teaching team, a link to register/track blog contributions and a couple other.

This is information that the students will need multiple times throughout the semester and should be able to find it quickly. The following image shows off a remnant of my initial solution – look at the “Course Content” block in the middle of the page and the links it includes.

Home page

You may also see from the above image that there is also a quite prominent menu in the left-hand column. A menu that appears to point to some of the same information (e.g. study schedule, assessment). This is a new feature of the institutional theme for Moodle that has been rolled out by my university.

It does help address this problem. But amongst other problems I’ve discussed earlier this particular prominent menu provides no scope to add course specific general information. For example, I can’t add a “Register blog – check posts” link.

Scroll of death

The scroll of death is a rather well-known problem with Moodle course sites. If you’re using the topic/week course format and your course has 10+ topics/weeks and each of those topics/weeks have a list of activities/resources, then your course home page is going to be quite long. This requires students to scroll on and on down the page to find where they are and what they should be doing next.

Keeping information up to date

My course is offered twice a year. Institutional policy means that we’re unable to make major changes to the course (especially the assessment) within a calendar year. Workload implications (such as dealing with concrete lounges) mean that even when I do make changes, those changes tend to be evolutionary, rather than revolutionary. Tweaking what’s already there, rather than a holus bolus replacement.

Which means my first step in preparing for a new semester (like many, many other academics) is to migrate the last course site across to the new semester’s course site.

The problem is that littered throughout all of the course information is a range of information that I

  1. have to change; and,
    e.g. assessment due dates, the dates associated with each week of semester.
  2. some that I might like to change.
    e.g. The title for a week. The name and email address of the person in charge of the course. etc.

The problem is that this information is not located in one place. It is littered throughout the course site. For example, the due date for an assignment can be found on the: study schedule, the assessment overview, the assignment page for that assignment, and an ad hoc collection of pages in Moodle books designed to help students prepare the assignment.

As it stands, I need to manually find (remember, no search engine) and replace all occurrences of this information.

Bricolage

Here’s an overview of the various workarounds I’ve employed to address the limitations of this concrete lounge.

No search engine

In the past – as explained in this post – I have manually imported most of the course content into Evernote and made it open to the public. This allows the use of the simple search engine provided by Evernote.

I won’t be doing this in the future. It’s too much work and difficult to keep the information in Evernote aligned with what’s in the course site. I believe it’s also somewhat difficult for students to connect this search result with what’s in the course site.

Topic-based moodle sites and general information

The image below shows the original solution I used (which is echoed in the image above).

A hand-coded bit of HTML is placed in the general section at the top of the course site. The HTML points students to the general information. The HTML is styled to align with the institutional look and feel. As you can see, it also takes up more vertical space contributing somewhat to the scroll of death.

edc3100 2014

As noted above, the institution has rolled out a new look and feel that includes a menu designed to help students find general information. In a perfect world, I’d make use of that menu to point students to the course specific information. Especially the study schedule and assessment information.

Whilst the institutional implementation doesn’t support this type of customisation. It is possible through the use of jQuery (a part of the new institutional look and feel). However, the use of this approach is apparently seen as a potential breech of policy.

Time will tell.

Scroll of death

The following shot of the next course site shows the addition of “skip navigation” for the weekly learning paths. Near the top of the page the students see an overview of the weeks of semester and can jump directly to the learning path for that week. Each of the links within the skip navigation has a tooltip that tells the student the topic for that week and the dates for that week (the dates are new and are possible due to the tinkering described in the next section). An attempt to help figure out where they were or should be up to.

tooltip

Keeping information up to date

The skip navigation in the previous screen shot, the study schedule shown above, and the week 1 learning path (also shown above) all display the title given to a week of semester and the dates for that week of semester. Traditionally, I’ve had to manually change all of this information. No longer.

I’ve now implemented a simple “macro” facility. This has been done by

  1. Create a small jQuery/javascript file that
    1. Defines a range of variables and their values.
      [code lang=”javascript”]
      var VARIABLES = {
      // Teaching staff
      CE_NAME: "David Jones", CE_EMAIL: "david.jones@usq.edu.au",

      // Weeks
      W0_PERIOD:"Before 2 Mar",
      W0_TITLE: "Orientation and getting ready",

      W1_PERIOD:"2-6 Mar", W1_LABEL: "Week 1",
      W1_TITLE: "ICT, PLNs and You",
      [/code]

    2. Will perform a search on a web page once it has loaded into a browser, and replace any occurrence of a variable (e.g. W0_PERIOD) with the value (e.g. Before 2 Mar).
  2. Include that file in any Moodle page that contains this type of information.
  3. Replace the “hard-coded” information with an appropriate variable.
    [code lang=”html”]
    <!– this –>
    Jump to: Week: <a href="#1" title="ICT, PLNs and You">1</a> |
    <!– becomes –>;
    Jump to: Week: <a href="#1" title="{{{W1_TITLE}}} – {{{W1_PERIOD}}}" class="dj_title">1</a> |
    [/code]
    Note: Due to the pain in making these modifications each semester the period for a given week was never included in the skip navigation. It was too much work to manually update each link in the skip navigation. However, with this functionality I only need to enter the variable once.

Next semester, all I’ll need do is create a new version of the VARIABLES containing the new semesters values. Changing this one file will then automatically ensure that it is change on all the pages that use this.

Two interesting issues I’m waiting for

  1. Will this use of jQuery generate any backlash from institutional management?
    The very fact that this is my first question says something about the context.
  2. What problems will this kludge generate in terms of students browsers?
    Will all browsers support this use of jQuery. Seems to work on iPads and modern computer browsers. But 300+ students will almost certainly create an issue.

Factors

This is just an initial stab. Needs more work.

The argument we made in this paper was that the reason why this concrete lounge exists (and also the reason why I’m able to make these changes) is that university e-learning at the institutional level is informed by a SET mindset whereas my practice is more informed by a BAD mindset.

The institutional practice is driven by strategic aims. Important institutional projects (such as the new institutional look and feel for Moodle) are the focus. It’s what everyone is meant to work toward. Anything that doesn’t fit within the strategic aims is seen as bad or below notice. A strategic project has to work at the level of the entire organisation, and not a the level of an individual course.

I’m not sure that the “keeping information up to date” is a problem that many of those involved in the strategic projects are aware of. If they aren’t aware of it, they can’t solve it.

But even if they are aware of it, it has to be seen as a problem for everyone and as a problem that can be solved within the available resource constraints.

The solution I’ve adopted for the “keeping information up to date” is – as it stands – an solution that just anyone could adopt. Transforming that solution into something that could be used across the institution would require a significant mindshift on a number of fronts from those involved centrally.

Learning analytics is better when…..?

Trying to capture some thinking that arose during an institutional meeting re: learning analytics. The meeting was somewhat positive, but – as is not uncommon – there seemed to be some limitations around what learning analytics actually is and what it might look like. Wondering if the following framing might help it draws on points made by numerous people about learning analytics and some strong echoes of the (P)IRAC framework

Learning analytics better when it

  1. knows more about the learning environment;
    (learning environment includes learners, teachers, learning designs etc.)
  2. is accessible from within the learning environment;
    i.e. learners and teachers don’t need to remove themselves from the learning environment to access the learning analytics.
  3. provides affordances for action within the learning environment;
    If no change results from the learning analytics, then there is little value in it.
  4. can be changed by people within the learning environment.
    i.e. learners and teachers (and perhaps others) can modify the learning analytics for their own (new) purposes.

The problem is that I don’t think that institutional considerations of learning analytics pay much atention to these four axes and this may explain limited usage and impact arising from the tools.

All four axes tend to require knowing a lot about the specifics of the learning environment and being able to respond to what you find in that environment in a contextually appropriate way.

The more learning analytics enables this, the more useful it is. The more useful it is, the more it used and the more impact it will have.

A few examples to illustrate.

Data warehouse

  1. What does it know about the learning environment? Limited
    Generally will know who the learners are, what they are studying, where they are from etc. May know what they have done within various institutional systems.
    Almost certainly knows nothing about the learning design.
    Probably knows who’s teaching what they’ve taught before.
  2. Accessible from the learning environment? Probably not
    Access it via a dashboard tool which is separate from the learning environment. i.e. not going to be emedded within the discussion forum tool, or the wiki tool.
    A knowledgeable user of the tool may well set up their own broader environment so that the data warehouse is integrated into it.
  3. Affordances for action? NONE
    It can display information, that’s it.
  4. Change? Difficult and typically the same for everyone
    Only the data warehouse people can change the representation of the information the warehouse provides. They probably can’t change the data that is included in the data warehouse without buy in from external system owners. IT governance structures need to be traversed.

Moodle reports

  1. What does it know about the learning environment? Limited
    Know what the students have done within Moodle. But does not typically know of anything outside Moodle.
  2. Accessible from the learning environment? Somewhat
    If you’re learning within Moodle, you can get to the Moodle reports. But the Moodle reports are a separate module (functionality) and thus aspects of the Moodle reports cannot be easily included into other parts of the Moodle learning environment and certainly cannot be integrated into non-Moodle parts of the learning environment.
  3. Affordances for action? Limited
    The closest is that some reports provide the ability to contact digitally students who meet certain criteria. However, the difficulty of using the reports suggests that the actual “affordances” are somewhat more limited.
  4. Change? Difficult, limited to Moodle
    Need to have some level of Moodle expertise and some greater level of access to modify reports. Typically would need to go through some level of governance structure. Probably can’t be change to access much outside of Moodle.

“MAV-enabled analytics”

A paper last year describes the development of MAV at CQU and some local tinkering I did using MAV i.e. “MAV-enabled analytics”.

  1. What does it know about the learning environment? Limited but growing
    As described, both MAV (student clicks on links in Moodle) and my tinkering (student records data) draw on low level information. In a month or so my on-going tinkering has the tool including information about student completion of activities in my course site and what the students have written on their individual blogs. Hopefully that will soon be extended with SNA and some sentiment analysis.
  2. Accessible from the learning environment? Yes
    Both are analytics tools are embedded into the Moodle LMS – the prime learning environment for this context.
  3. Affordances for action? Limited but growing
    My tinkering offers little. MAV @ CQU is integrated with other systems to support a range of actions associated with contacting and tracking students. Both systems are very easy to use, hence increasing the affordances.
  4. Change? Slightly better than limited.
    MAV has arisen from tinkering and thus new functionality can be added. However, it requires someone who knows how MAV and its children work. It can’t be changed by learners/teachers. However, as I am the teacher using the results of my tinkering, I can change it. However, I’m constrained by time and system access.