Results

The questionnaires were distributed electronically and, after some follow-up, 24 responses were received in 2006, 24 responses were received in 2005 and 25 responses were received in 2004. This represents a response from about 60 per cent of the universities. A number of universities, however, have no IS discipline group, so the effective response rate is more than 80 per cent (of the 30 or so IS groups) and can therefore be claimed to be representative of the population of IS groups as a whole. There is a mix of titles (most commonly schools, but also departments and other titles), but hereafter the groupings will be referred to as schools. The discipline titles of these schools of the 24 respondents in 2006 were 50 per cent (12 respondents) IS, 25 per cent information technology (IT) and 25 per cent other titles. Furthermore, 14 of these schools were in a business/commerce faculty, seven in an IT faculty and three in a mix of others.

Academic staff levels are shown in Table 11.1 and indicate a 2006 mean of 16.3 total academic staff in IS schools, with a reduction in size evident from 2004 and 2005. This is consistent with the reduction in IS student numbers during this period. Table 11.2 shows a breakdown into staff categories and highlights the low number of senior staff (levels D and E) and research-only staff (research fellows) in each school.

Table 11.1 Academic staff levels

 

Mean

2004

Range

2004

Mean

2005

Range

2005

Mean

2006

Range

2006

             

Continuing

17.8

2–40

17.2

1–41

14.4

3–30

Contract

2.5

0–12

2.0

0–7

1.9

0–7

Total academic staff

20.3

 

19.2

 

16.3

 

The overall view is that there is a mix of names and locations for IS schools, but the majority are medium-sized groups with IS in the name and reside in a business/commerce faculty where they can maintain a close association with the areas of application of IS.

Table 11.2 Academic staff categories

 

Mean

2004

Range

2004

Mean

2005

Range

2005

Mean

2006

Range

2006

Research fellows

0.9

0–5

0.7

0–4

0.7

0–4

Level Es (professors)

1.3

0–3

1.4

0–3

1.3

0–3

Level Ds (associate professors)

2.0

0–11

1.7

0–4

1.6

0–5

Level Cs (senior lecturers)

4.8

0–13

5.3

0–14

4.0

0–11

Level Bs (lecturer Bs)

8.7

0–23

7.9

1–22

7.3

1–18

Level As (lecturer As)

2.8

0–11

2.1

0–10

1.6

0–8

Total

20.5

 

19.1

 

16.5

 

Staff research activity levels are shown in Table 11.3 and indicate that in 2006 the majority (mean 83.7 per cent) of staff were doing some research although only about half of these were research active according to the strict Department of Education, Science and Training (DEST) definition (mean 41 per cent). Just more than half (mean 57.5 per cent) have PhDs and a further quarter are doing PhDs (mean 23.6 per cent). Just more than one-third (mean 37.6 per cent) are supervising PhDs and one-quarter (mean 25 per cent) have supervised a PhD to completion. It can be seen that although the proportions of staff doing some research and those considered DEST research-active have remained about the same, there has been an increase in the number of staff with PhDs and in supervision in the period 2004–06.

Table 11.3 Staff research activity

 

Mean 2004

Range 2004

% 2004

Mean 2005

Range 2005

% 2005

Mean 2006

Range 2006

% 2006

Doing some research

-

-

-

15.3

1–37

80.1

13.4

4–30

83.7

Research active (DEST)

7.9

0–21

43.9

6.3

0–18

37.5

6.0

0–18

41.9

Doing PhDs

-

-

-

5.2

1–16

28.7

3.8

0–11

23.6

Have PhDs

8.7

2–24

43.5

9.3

1–24

51.3

8.6

3–22

57.5

Supervising PhDs

6.1

1–15

31.6

6.2

1–16

36.0

5.7

1–16

37.6

Supervised ≥1 PhD to completion

3.1

0–8

17.0

3.3

0–8

19.8

3.5

0–9

25.0

Doctoral student numbers are shown in Table 11.4 and it can be seen that the mean number of doctoral students and the mean number of PhD completions per school have remained much the same since 2004. The results indicate that in 2006 the mean number of full-time equivalent (FTE) PhD students in each school was 11.5 (7.8 full-time and half of 7.4 part-time), while the mean number of PhD graduations per school in the previous year was 1.4. With that many PhD students, there would be an expectation of three to four graduates per annum (based on a target of 3.5 FTE years for completion of a PhD), but the real completion rate is less than half that. This signals a throughput problem, which might exist because of variable-quality supervision practices (within schools and across the sector) and a lack of adequate resources, which needs to be addressed.

Table 11.4 Doctoral student numbers

 

Mean

Range

Enrolled full-time 2004

8.0

0–25

Enrolled part-time 2004

7.9

0–23

Enrolled full-time 2005

8.2

0–21

Enrolled part-time 2005

8.4

0–23

Enrolled full-time 2006

7.8

0–26

Enrolled part-time 2006

7.4

0–25

2002 graduates

0.6

0–2

2003 graduates

1.3

0–6

2004 graduates

1.6

0–5

2005 graduates

1.4

0–3

2006 graduates (half-year)

1.0

0–4

Respondents were asked to indicate the topics of research interest in the past, present and future, and responses for the 2006 survey are summarised in Table 11.5 below, sorted by future topic of interest. The results demonstrate the substantial interest in research on IS management and strategy and the organisational implications of IS and IT, IS adoption/diffusion, electronic commerce and knowledge management, with almost all groups indicating an interest in these areas. In addition, interest is strong in topics such as IS development and business modelling, mobile commerce and the theoretical underpinnings of IS. On the other hand, specific topics and technical issues such as computer and network applications and computer-supported cooperative work (CSCW)/groupware are relatively less popular. It should be pointed out, however, that the table reveals how many groups are interested in these topics and does not show how large these groups are. So, further research is needed at the individual researcher level.

The respondents were asked also to indicate the usual unit of analysis of their research. In the 2006 survey this was the organisation (22 responses), groups/teams (19), clusters of organisations (19), industry (16), processes/tasks (15), individuals (14), national economy/society (eight) and world economy/society (three). Clearly, researchers focused most on organisations and the people within them, and significantly less on studying IS at the national or global levels. This could represent an opportunity to collaborate with other researchers (for example, economists) to investigate the impact of IS and information technologies on Australia’s economy and its links with the region and globally. In terms of a research paradigm, responses revealed dominance of the positivist paradigm (in 71 per cent of schools), but the interpretivist paradigm was also used often (54 per cent). The survey data confirmed a growing recognition that IS researchers in Australia did conduct research based on non-positivist research paradigms. Few mentioned any significant emphasis on research using a critical paradigm, which was also the case at the international level (Mingers 2001).

Table 11.5 IS research topics (2006 survey data)

Topic

Past

Present

Future

Topic

Past

Present

Future

Organisational implications of IS&T

19

21

20

Human–computer interaction

11

11

10

IS management/strategy

17

17

16

Systems development

13

10

9

Electronic commerce

19

18

16

Knowledge-based/expert systems

11

12

9

IS adoption/diffusion

16

16

15

Economic effects of IS&T

5

8

8

Knowledge management

13

17

14

Databases

9

9

8

Theoretical underpinnings of IS

15

14

13

DSS/EIS/data warehousing

9

9

7

IS development methods

12

12

13

IS outsourcing/offshoring

5

7

7

Mobile commerce

7

13

13

Legal/ethical aspects of IS&T

8

8

7

Business modelling

10

13

13

Computer and network applications

3

3

3

Societal effects of IS&T

10

12

11

CSCW/groupware

6

3

3

IS security

8

9

10

       

When asked to indicate the specific research methods used, the responses revealed that the full range of research methods were being applied by IS researchers (see Table 11.6 below, sorted by the research method used most often). The most popular method is the survey, but also popular are positivist and interpretive case studies, and design science. This balanced application of paradigm and method is perhaps an indicator that Australian IS researchers are more like their European than their North American counterparts. Arnott and Pervan (2005) found that, in published research in decision support systems, North American journals were overwhelmingly positivist whereas European journals were more balanced on paradigm and method. Again, these data are at a school level, so a study of individual researchers is needed to reveal the true extent of usage of the different methods.

Table 11.6 Research methods used (2006 survey data)
 

Never

Sometimes

Often

Always

Survey

0

7

16

1

Interpretivist case study

2

7

15

0

Positivist case study

3

10

11

0

Design science

0

13

10

1

Literature meta-analysis

5

13

2

4

Business modelling/simulation

7

11

4

2

Secondary data analysis

5

13

5

1

IS development

6

12

6

0

Action research

6

13

5

0

Conceptual study

4

16

3

1

Ethnography

10

11

3

0

Longitudinal case study

5

17

2

0

Laboratory experiment

11

11

2

0

Respondents in the 2006 survey indicated clearly that the primary beneficiaries of their research were other IS academics (20), managers (17) and IS professionals (15 responses), followed distantly by end users/workers (seven), policymakers (six) and people in general (zero). This might again show that we (IS researchers) are not taking up the opportunity to influence governments and society, and it could be a major reason for the apparent lack of recognition of IS as a discipline by some government agencies. Respondents indicated that, where it occurred, most research collaboration occurred with IS colleagues within that particular academic group. Clearly, there is a need to widen the collaboration net nationally and internationally, which could help to increase quality, and with practitioners, which increases relevance and provides opportunities for funding—for example, the Australian Research Council (ARC) Linkage grants. It could also serve to enhance the impact of IS research, which might be an advantage in the research quality-assurance mechanism that will replace the proposed Research Quality Framework (RQF), once developed. The planned RQF was abandoned in December 2007 by the new Labor government.

School research output is shown in Table 11.7 and indicates that in 2006 schools generated a mean of about 52 publications, 34 of which were conference papers, 11 journal papers and a small number of other types. It can be seen that there has been a substantial increase in the mean number of publications in the period 2002–05. The largest increase has been in conference papers, although the number of journal papers has also increased.

Table 11.7 Publications per school

 

2002

mean

2003

mean

2004

mean

2005

mean

Refereed journal papers

6.3

10.0

9.8

11.0

Refereed conference papers

21.1

29.2

29.1

33.8

Chapters in books

4.3

3.7

3.4

5.3

Authored books

0.4

0.9

0.4

0.6

Edited books/proceedings

0.6

0.8

0.5

1.7

Total publications

32.7

44.6

43.2

52.4

Research performance per staff member is shown in Table 11.8 and indicates that in 2005 the mean output per academic staff member was 2.6 publications per annum and the mean grant income per academic staff member was about $17 800 per annum. It can be seen that there has been a substantial increase in publications and grant income since 2002, although the rate of increase has decreased substantially and the differences between 2004 means and 2005 means are very small. Further, Tables 11.7 and 11.8 reveal that the mean number of journal papers (of any type—there was no assessment of journal quality) per IS academic is much less than one per annum. Follow-up investigation would be required to determine publication rates in tier-one and tier-two journals, but it is certain to be even lower. This would have severely limited the chances of IS research groups achieving a high rating in the proposed RQF process—thus constraining IS research funding.

Table 11.8 Research performance (per staff member)

 

Mean

Median

Range

2002 publications

1.6

1.3

0.0–4.4

2003 publications

2.3

2.1

0.0–6.7

2004 publications

2.3

2.4

0.4–3.9

2005 publications

2.6

2.2

0.3–8.5

2002 grant $K

8.9

2.8

0.0–45.6

2003 grant $K

15.5

9.7

0.0–48.9

2004 grant $K

17.0

14.8

0.0–63.6

2005 grant $K

17.8

15.0

0.0–53.3

Research grant income per school is shown in Table 11.9 and indicates that in 2005 the mean grant income was more than $300 000 per annum. The amount of research grant income varied considerably between the groups, with a few groups doing very well in gaining funds from external sources, but most having to depend on internal university resources. The main source of research grant income in 2006 was from the ARC (Linkage and Discovery grants), although substantial research income was also generated from collaborative research centres (CRCs), industry contracts and internal university resources. It can be seen that although the total research income increased significantly after 2002, it has remained much the same throughout 2003–05. Generally, these figures compare poorly with other disciplines, including computer science and computer engineering.

Table 11.9 Research grant income ($K) (per school)

 

2002

mean

2002

median

2003

mean

2003

median

2004

mean

2004

median

2005

mean

2005

median

ARC Linkage

68.9

0.0

107.8

0.0

90.2

6.0

98.8

20.0

ARC Discovery

32.4

0.0

58.4

0.0

64.8

0.0

33.7

0.0

Internal university

32.5

20.0

58.5

45.0

47.6

15.6

58.6

20.0

CRC

-

-

-

-

46.5

0.0

60.0

0.0

Industry contract

10.5

0.0

32.8

0.0

46.3

0.0

41.2

0.0

Consulting

4.4

0.0

12.3

0.0

9.6

0.0

11.4

0.0

International

8.0

0.0

3.1

0.0

4.8

0.0

1.1

0.0

Other (various)

22.8

0.0

28.8

0.0

3.3

0.0

0.0

0.0

National Health and Medical Research Council (NHMRC)

-

-

-

-

0.0

0.0

2.0

0.0

Total

179.5

 

301.7

 

313.1

 

306.8

 

Table 11.10 shows a comparison of several research variables with significantly different means across university categories. The university categories are based on those of Marginson and Considine (2000) and provide a useful means of comparing research performance. The categories are defined as follows (Marginson and Considine 2000:15–16):

It is clear from Table 11.10 that the mean size of IS schools in each of the categories is very similar. The Sandstone/Redbrick and Unitech categories have, however, significantly greater mean numbers of professors, mean numbers of DEST research-active staff, mean numbers of doctoral students, mean numbers of papers in refereed journals and refereed conferences, mean numbers of publications per staff member, mean total amounts of grant income and mean grant incomes per staff member. This is consistent with the research-intensive nature of universities in the Sandstone/Redbrick category and the historical location of IS schools within the Unitech universities.

Table 11.10 2006 significant means across university categories
 

Sandstone/ Redbricks

Unitechs

Gumtrees

New

Total academic staff

15.5

17.0

17.8

16.1

Number of professors

1.4

2.3

0.3

0.9

Number of DEST research active

8.5

6.3

3.3

4.2

Number of doctoral students (EFT)

16.0

12.7

6.7

7.4

Papers in refereed journals

14.0

13.2

7.3

7.8

Papers in refereed conferences

39.5

51.2

17.3

21.2

Publications per staff member

3.0

3.5

1.2

2.0

Total grants ($,000)

397.1

500.8

26.0

179.1

Grant $ per staff member ($,000)

23.6

29.1

0.9

10.0

The final part of the survey allowed each respondent to suggest the three main strengths, weaknesses, opportunities and threats (SWOT) for the IS discipline research; a summary of the most frequently cited issues in the 2006 survey is provided in Table 11.11. In total, more than 150 ideas were generated in the SWOT and the top five in each category are presented here.

Table 11.11 Results from the SWOT analysis

Strengths

Weaknesses

Industry relevance and links (10)

Lack of industry relevance (8)

Diversity of method (6)

Lack of identity of IS as a discipline (6)

Diversity of research undertaken (5)

Poor funding and recognition by funding bodies (6)

Feeling of community (ACIS, ACPHIS) (4)

Poor/variable research training (5)

Critical mass of quality IS researchers (3)

Conflicts of research focus (5)

Opportunities

Threats

Industry collaboration/linkage grants (13)

Falling student numbers/staffing (9)

Raising profile in industry and government (6)

Other fields claiming IS as their own (8)

Cooperative doctoral research training (4)

Lack of research funding (6)

Collaboration generally (3)

Nelson Higher Education Policy/Research Quality Framework (6)

Improved quality and success (2)

Lack of industry relevance/recognition (4)

The respondents clearly believe there is strength in our diversity and relevance. Diversity was indicated in types of research undertaken, the research approaches taken (and the underlying epistemology) and in the breadth of experience most IS researchers brought with them from their background in IS practice and their grounding in practitioner activity. These strengths in diversity and relevance need to be nurtured and exploited.

Key weaknesses are the lack of relevance and identity and poor funding (relative to computer science/computer engineering), which is associated with other weaknesses such as the lack of a research culture in Australian business and lack of recognition from funding agencies such as the ARC. These and other research focus and training issues need to be overcome.

The respondents clearly recognise that there are numerous opportunities of which we should attempt to take advantage. In this, collaboration (with industry, international colleagues and other Australian universities) is the key. In addition and as indicated earlier, the opportunity exists for IS to increase its profile and recognition by conducting research on societal and economic issues, which might influence government policy.

While industry collaboration was seen as an opportunity, it could also be a threat if proper linkages were not built. Research impact will be critical in any research quality-assurance mechanism. Perhaps the greatest threats to IS research in Australian universities lie in the lack of recognition of IS as a discipline and its location in the academic structure, the falling numbers and excessive teaching loads in most schools and the career and financial opportunities outside academia.