kocdata.txt: Unformatted text file (Latin-1 or 'Windows' coding) containing all the data of Len Barchak' (1977, 1984) dissertation. Compiled by Peter.Schmolck@unibw-muenchen.de for the QMethod Page's "Q Studies Data Set Archive" - http://www.rz.unibw-muenchen.de/~p41bsmk/qmethod/qsdsa.htm May 1998 Copyright of original material by Leonard J. Barchak (barchak@acc.mcneese.edu) Sources: Barchak. L.J. (1977). Knowledge or certainty? An investigation of the subjective structure of some communication scholars (Doctoral dissertation, University of Iowa, 1977). Dissertation Abstracts International, 38, 1718A. Barchak, Leonard J. (1984). Discovering Communication Paradigms with Q Methodology: Ferment or Sour Grapes?. Operant Subjectivity, 7, 115-130. (available also as Web document, URL: http://www.rz.unibw-muenchen.de/~p41bsmk/qmethod/koc/ljbos7-4.htm) Barchak, Leonard J. (1997). Paradigm and specificity: An empirical record and interpretation of William Stephenson's philosophy of science, 1975-1984. Paper presented at the workshop 'A Celebration of the Life and Work of William Stephenson (1902-1989)' at the University of Durham, 12-14 December 1997. ------------------------------------------------------ Table 1: Fisherian Design for "Knowledge or Certainty?" and Q-Sort Design Main Effects Levels A. Science (a)scientists (b)methods (c)intellectual products B. Valence (d)certainty (e)uncertainty Disagree Neutral Agree Score -5 -4 -3 -2 -1 0 +1 +2 +3 +4 +5 Frequency 1 2 3 4 5 6 5 4 3 2 1 ------------------------------------------------------ Table 2: Statements 01. All information is imperfect. (ce) 02. Methodology can dehumanize people and turn them into numbers. (be) 03. That which is unknown at present is not unknowable, but as yet undiscovered, anything can eventually be known in its entirety. (cd) 04. Scientists have a more perfect road to knowledge than do philosophers. (ad) 05. The results of proper scientific experiments speak for themselves. (bd) 06. All information between human beings can be exchanged only within a play of tolerance, whether in literature, religion, politics, or science. (ce) 07. The scientist strives to delineate man, not just sketch him. (ad) 08. Science separates the world from our perception of it. (cd) 09. Human error cannot be taken out of scientific observation. (be) 10. The world shifts under our gaze, interacting with us, and the knowledge that it yields must be interpreted by us. (ce) 11. The scientist who claims that absolute knowledge is attainable opens the door to tragedy. (ae) 12. It is important that students bring a certain ragamuffin, barefoot irreverence to their studies. (ce) 13. It may be said that a true scientist has an itch for absolute knowledge. (ad) 14. Philosophers have a road to knowledge more perfect than that of observation. (bd) 15. Although we devise ever more precise instruments, we are discomfited to see that our observations are still fuzzy and as uncertain as ever. (be) 16. Scientific methodology, correctly employed, results in unimpeachable conclusions. (bd) 17. Whenever instruments of sufficient precision are available, even the finest features of phenomena can be isolated and analyzed. (bd) 18. Whatever fundamental units constitute the world, they will not long evade our most sensitive methods and instruments.(bd) 19. Certainty is achieved through observation, never inference. (bd) 20. Physical science has shown that it is the only avenue to knowledge. (cd) 21. It cannot be expected that there will be a better estimate of a phenomenon than the average of several measurements. (be) 22. Error is not inextricably bound up with the scientist's knowledge. (ad) 23. Scientific knowledge is subjective knowledge for which the scientist must be held responsible. (ae) 24. When scientists believe that they have absolute knowledge, they behave arrogantly and dogmatically . (ae) 25. No event can be measured with certainty. (be) 26. Scientific method is a tribute to what we can know although we are fallible. (be) 27. An aim of the scientist is to give an exact picture of the material world. (ad) 28. The scientist expects the world to be inexact. (ae) 29. New ideas in science amount to different views of reality. (ce) 30. The would-be scientist is not at a university to worship what is known but to question it. (ae) 31. Every judgment in science is a product of the individual scientist and stands at the edge of error. (ae) 32. Where people argue and contradict science cannot exist. (cd) 33. The scientist completes his work by arriving at a mathematical formulation. (ad) 34. Science progresses step by step by eliminating error. (cd) 35. Judgment is built into acts of recognition. (ce) 36. Only in science can we be certain that what we know is true. (cd) ------------------------------------------------------ Table 2a: Statements, abbreviated to 60 chars for use with PQMethod ce-All information is imperfect 01 be-Methdlgy can dehumanize people and turn them into numbers02 cd-Anything unknown at present will evntlly be known entrly 03 ad-Scientists' road to knwldg more prfct than philosophers' 04 bd-Reslts of proper scntfc experiments speak for themslvs 05 ce-Information exchanged only within a play of tolerance 06 ad-The scntst strives to delineate man, not just sketch him 07 cd-Science separates the world from our perception of it 08 be-Human error cannot be taken out of scientific observation09 ce-The world shifts under our gaze, interacting with us ... 10 ae-Who claims absolute knowledge opens the door to tragedy 11 ce-Ragamuffin, barefoot irreverence important for students 12 ad-A true scientist has an itch for absolute knowledge 13 bd-Philosophers' road to knwldg more perfect than observtn 14 be-Observations are still fuzzy and as uncertain as ever 15 bd-Scientific methdlgy results in unimpeachable conclusions 16 bd-Whenever instruments of sufficient precision are avlble..17 bd-Fundamental units of world will not long evade our methds18 bd-Certainty is achieved through observation, never infrnce 19 cd-Physical scnce has shown to be the only avenue to knwldg 20 be-One cannot xpct to find a better estimate than the avrge 21 ad-Error not inextricbly bound up with the scntst's knwldg 22 ae-Scientific knwldg is subjtv knwldg, scntst is respnsble 23 ae-Sctst claiming absolute knwldg is arrogant and dogmatical24 be-No event can be measured with certainty 25 be-Scntfc mthd tribute to wht we can know thgh bng fallible 26 ad-One of scntsts' aim is exact picture of the material wrld27 ae-The scientist expects the world to be inexact 28 ce-New ideas in science amount to dffrnt views of reality 29 ae-Would-be scntst: not to worship the known but to qustn it30 ae-All jdgmnts product of indvdl scntst and at edge of error31 cd-Where people argue and contradict science cannot exist 32 ad-Scientist completes work by arrvng at a mathmticl formltn33 cd-Science progresses step by step by eliminating error 34 ce-Judgment is built into acts of recognition 35 cd-Only in science can we be crtn that what we know is true 36 ------------------------------------------------------ Table 3: P-Set (Case-Id, Name, Country of origin) 01Edelst Edelstein, Alex USA 02Larsen Larsen, Otto N. USA 03Rubins Rubinstein, Eli A. USA 04Werner Werner, Anita Norway 05Smith Smith, Alfred G. USA 06Roseng Rosengren, Karl Erik Sweden 07Berger Berger, Arthur Asa USA 08Barcus Barcus, F. E. USA 09Linné Linné, Olga Denmark 10Pool Pool, Ithiel de Sola USA 11Himmel Himmelweit, Hilde United Kingdom 12Beinst Beinstein, Judith USA 13Pisare Pisarek, Walery Poland 14Maletz Maletzke, Gerhard Singapore 15Nakaji Nakajima, Iwao Japan 16Sicins Sicinski, Andrzej Poland 17Kato Kato, Hidetoshi Japan 18Lyle Lyle, Jack USA 19Lerg Lerg, Winfried B. West Germany 20Escarp Escarpit, Robert France 21Rühl Rühl, Manfred West Germany 22Tanaka Tanaka, Yasumasa Japan 23Goyer Goyer, Robert S. USA 24Uno Uno, Yoshiyasu Japan 25Mestro Mestrovic, Matko Yugoslavia 26Kubin Kubin, Jerzy Poland 27Campea Campeanu, Pavel Romania 28McQuai McQuail, Denis United Kingdom 29Barbic Barbic, Ana Yugoslavia 30Singh Singh, Kusum USA 31Brown Brown, Roger USA 32Dajani Dajani, Nabil H. Lebanon 33Berlo Berlo, David USA 34Koning Koning, Thomas L. de South Africa 35Lazars Lazarsfeld, Paul F. USA 36Cherry Cherry, Colin United Kingdom 37Noelle Noelle-Neumann, Elisabeth West Germany 38WS1975 William Stephenson, 1975 UK/USA ------------------------------------------------------ Table 4: Q-Sort data (PQMethod raw data input file koc.dat with the two leading header records) 0 38 36 KOC: Knowledge or certainty (Barchak, 1977) -5 5 0 1 2 3 4 5 6 5 4 3 2 1 0 0 0 0 0 0 0 0 01Edelst 1 0-1-2 0 2 3-4 1 1 5 1-2-3 0-5-1-2-1-3 0-1 2 4 2 0-2 1 2 3 0-4-1 4 3-3 02Larsen 3-1 0-2-1 1 0 0 0 1 0 2-3-2 1-2 0-1-3-4 4 2-1 1 3 2-1 1 3 4-2-4-3 5 2-5 03Rubins 5-1-5-2-2 1 2-1 4 0 0-1 1-1 3-3-4-4 0-3 1-3 0 1 3 4 0 0 1 2 2-2-2 3 2-1 04Werner -1-2 0 1-1 2 2-2 3 3 2 4 3-3 1-2-3-5-1-2-4 2 0 4-1 0 0-1 1 5 0-4-3 1 1 0 05Smith 5-2-1-2-3 4-1 0 3 3 2 1-1-4 1-4-1-2-2-3 0 0 0 3 4 0-3 2 1 2 1-5-1 0 2 1 06Roseng 2-3 0 1-2 2 3-4 2 2-1 1 3-5-1-1 1-1-2-3 4-1-4 0 1 0 3 0 0 5-3-2 0 4 1-2 07Berger 4 1-1-4-1 3 2 0 0 5-3 2 0-3 2-2-1-1-1-5-4-2 4 1 1 3-3 0 2 1 3-2 0-2 1 0 08Barcus -2-2-3-4-1 0 2 0 1 2 0 1 4-4-1-3-1-5 4-3 2 0 2 0 0 3 1 1 1 5-1-2-1 3 3-2 09Linné 1 3-1-4-2 0 2-3 4 5 3 1-2-2-1-1-3 0-2-4 2 1 4 0-1 2-1 0 0 2 3 0-5 1 1-3 10Pool 5-5 0-3 0 2 1 1 3 3-1 1-3-4 0-2 0-1-2-3-2-1 1-4 4 2-1 3 0 0 2-1 1 2 4-2 11Himmel 2-3 2 1-2-3 2 0 3 4 1 0 3-1 0-4-2-3-2-2 0-4 1 4 3 0-1-1 1 1 2-5-1 5 0-1 12Beinst 1-1-1-1-2 2 2-3 4 1 0 1 0-2 1-3 0-2 0-4 0-3-2 2 5 0-1 3 2 3 3-5-1 1 4-4 13Pisare -2 0 5 1 2 0 2-2-3 1-5-2 2-3-2 2 3 4-1-1-1 3 0 0-3-1 4-1 1 0-4-4 1 3 1 0 14Maletz 3 1-4-2-2 4 0 2 3 3 2 0-1 1 4-2-3-1-1-4 0 1 0 5-5 1-1 0 2 1 2-3-2-1 0-3 15Nakaji 3-1-2 0 1 3 1 2 4 2 0-1 2 0 1-5-1-4-4-3-3 0-2-2-2 5 1 0 0 4 1-1-1 3 2-3 16Sicins 3-3-1 0 0 2 0-4 5 2-1-2-1-2 0 1 1-3-1-4-1 1 0-2 3 4 4 0 3 2 1-3-5 1 2-2 17Kato 2-1-4-3 0 2-1 1 2 4 3 1-1 1 2-2 0 0-5-3-1 0-2 1 5 3-2-1 1 3 4-4-2 0 0-3 18Lyle -2 1 1 1 2 4 0-2 2 5 1 0 3-5 1-2-2-1-4-3-3 3-1 2-3 4-1 0 0 2 0-4-1 3 0-1 19Lerg 0 1-1 0 0 3 0-4 3 5 1 1-1 0 2-3-1-3-1-2-2-3 2 1 1 2-5-4 4 2 3 0-2-2 4-1 20Escarp 2-1 0 1 0 0-3-3-1 3-3 0 3-1 0-2-1-1 3-2 1 0 5 2 1 2-2 4 1 1-4-5 4-2 2-4 21Rühl 5-1-1 2-4 1 1 0 4 1 1 0 0-2 0-3-3 0 0-3-1-1 1-5 4 2-2 2 3 3 2-4-2-2 3-1 22Tanaka 0-5 3-4 0 2 3-2 1 2 0-4-2 0 1-3 1 1-3-3-1 0 2 0-1 3 1-2 5-1 4-1-1 4 2-2 23Goyer 1 2 0 0-4 4 3-2 1 4 0-1-2 0-3-1 2-2 1-4 2-3-1-1 1 5-1 3 1 3 0-5-2 0 2-3 24Uno -3-1 1 2-1 0 0-1 4 2 2 0 3-2 2 1-1 0-3-4-3 1-5-2 0 5-2-1 4 1-2-4 1 3 3 0 25Mestro 2-3 1-3 2 2 1 0-1 3-1-5-2-2-1-2 0 0-1-4 1 4 0-2-1 4 2 1 1 3-3-4 0 5 3 0 26Kubin 1-5 1 2 3 3 2 3-3 1 1 0-3-4 1-2-1-4 2-3-2 2-1 0-2 0 4-1 0 5-1 0-1 4 0-2 27Campea 4 2 2-1-3 2 0-2-2 0 1 3-1-1-4-2-1 0-5-3-2 2 4 1 3 1 3 0-1 1-3-4 0 1 0 5 28McQuai 1 0-2-3-3 2-1-1 4 3 0 0-1 0 2-5-2-1 1-2-3-4 0 3 5 1 2 0 2 1 1-2-4 3 4-1 29Barbic 1-1 5-4 2 4 2 1-2 1 0 0-5-4 3-1-2 3-3-3-1 0 1 0-1 2 1-3-1 4 0-2-2 2 3 0 30Singh 0 2-1-2-2 5 2-4 2 0 3 4 1-3 0-1-1-2-1-5 3-2 0 1 3 1-1 0 2 4 0-3-3 1 1-4 31Brown -1 3 5 4-2 0 1 2-1 2 1 1 0-3 2-4-3-2-3-2 0 3-5 3 0 4-2 0 0 2-1-1 1-1 1-4 32Dajani 0-3 3-4 4 1 1-1 3 2-2 0 0-3-1-2-2-1 0-5 2 1 1-1 2 4-1 0 1 5 3-4-3 2 0-2 33Berlo 5 1-3-2 0 3 0-1 3 3-1-5 1-2-2-4 1-1 0-2 2-4 0-1 4 2-3 1 2 2 1-3 0 0 4-1 34Koning 1 1-1 1 1 4 2-4 0 5-1 3 2-1-3 0 0-2-3-5-1 1-2-2 0 2 0 0 4 3-2-3-4 2 3-1 35Lazars 2-3 2 4-4 0 1-3 4 3 0 0 0-5-2-4-1 1 0-3 2-1-2-2-1 3 1 0 2 1 5-1-1 1 3-2 36Cherry 4-1-1-3-1 5 1 3 2 4 0 1 0 1-2-3-1-2-3-5 0 1 0 0 2 0-2 1 2 2-1-4-2 3 3-4 37Noelle 1-1 4-3-1 0 1 0 2 0-5-1 0-3 3-2 0 1 5-2 0 1-2 4 3 2-2 2 3-1-1-4-4 2 1-3 38WS1975 3 1-2 0-1 5 1-4 2 1 4 2 1-5 2-2-1-1 0-4 2-3-3-1 1 4-2 3-3 0 3-2 0 0 0-1 ------------------------------------------------------ Table 5: Centroid Factor Solution for Seven Factors (based on Table 3-4 in Barchak, 1977) 01Edelst 0.774 0.079 -0.112 0.142 0.271 0.170 -0.077 02Larsen 0.745 -0.134 -0.161 -0.034 0.077 0.050 -0.227 03Rubins 0.748 0.287 -0.003 -0.035 0.109 -0.242 -0.164 04Werner 0.635 -0.163 0.215 0.317 0.357 0.123 0.167 05Smith 0.805 0.287 -0.124 0.103 0.090 -0.021 0.168 06Roseng 0.570 -0.346 0.005 -0.377 0.257 0.009 -0.090 07Berger 0.644 0.245 -0.094 0.193 -0.227 0.240 0.188 08Barcus 0.603 -0.074 -0.083 -0.165 0.274 0.129 -0.170 09Linné 0.616 0.117 0.134 0.109 -0.121 0.245 -0.220 10Pool 0.653 0.042 -0.290 -0.050 -0.310 -0.186 0.021 11Himmel 0.611 0.006 -0.092 0.083 0.217 -0.134 0.246 12Beinst 0.820 0.245 -0.006 -0.236 0.209 -0.079 0.078 13Pisare -0.037 -0.832 -0.213 -0.123 -0.058 0.278 0.287 14Maletz 0.539 0.192 0.131 0.419 0.077 -0.075 -0.173 15Nakaji 0.696 -0.135 0.168 0.113 -0.083 -0.318 -0.155 16Sicins 0.697 -0.140 0.003 -0.251 -0.226 -0.099 -0.037 17Kato 0.684 0.262 0.077 0.212 -0.121 -0.195 -0.121 18Lyle 0.612 -0.417 0.323 0.268 0.014 0.139 0.134 19Lerg 0.598 0.309 0.220 0.201 -0.153 0.094 0.079 20Escarp 0.315 0.035 -0.198 -0.235 0.145 0.164 0.268 21Rühl 0.679 0.254 0.038 -0.230 -0.196 -0.157 0.211 22Tanaka 0.506 -0.182 -0.214 0.105 -0.372 -0.117 -0.011 23Goyer 0.687 0.055 0.066 -0.326 -0.075 0.112 -0.072 24Uno 0.481 -0.336 0.380 -0.066 -0.002 -0.206 0.252 25Mestro 0.538 -0.554 -0.390 -0.054 -0.244 -0.038 -0.227 26Kubin 0.332 -0.543 -0.110 0.172 0.151 -0.115 -0.245 27Campea 0.276 -0.000 -0.105 0.089 -0.075 0.300 0.039 28McQuai 0.688 0.269 -0.151 0.081 0.045 -0.153 0.049 29Barbic 0.438 -0.349 -0.223 0.336 -0.209 0.076 -0.076 30Singh 0.748 0.096 0.180 -0.091 0.212 0.349 -0.244 31Brown 0.357 -0.224 0.276 0.127 0.216 -0.070 0.202 32Dajani 0.718 -0.254 -0.156 -0.055 -0.080 0.037 -0.081 33Berlo 0.655 0.364 -0.151 -0.333 -0.196 -0.020 -0.007 34Koning 0.666 -0.266 0.268 -0.096 -0.181 0.268 -0.000 35Lazars 0.593 -0.066 0.202 -0.243 -0.049 -0.133 0.138 36Cherry 0.797 0.027 -0.125 0.082 -0.085 -0.070 -0.115 37Noelle 0.430 -0.035 -0.369 -0.166 0.221 -0.095 0.183 38WS1975 0.600 0.223 0.315 -0.179 0.098 0.060 -0.056 ------------------------------------------------- Table 6: Rotation angles (read from factor-plot figures, P.S.) Step Factor Factor degrees (vert.) (hor.) ------------------------------ 1. 1 2 -55 2. 1' 4 -39 3. 2' 4' -38 4. 3 2'' 58 5. 1'' 3' -22 6. 4'' 2'' -40 ------------------------------------------------- Table 7: Hand-Rotated Factor Solution (based on Table 3-6 in Barchak, 1977; rightmost column added to allow for reordering lines as in '77-Table 3-7 / '84-Table 2) A B C D 01Edelst 0.10 0.64X 0.28 0.40 06 02Larsen 0.35 0.56X 0.29 0.28 11 03Rubins 0.00 0.57 0.50 0.27 31 04Werner 0.12 0.28 0.18 0.65X 25 05Smith -0.08 0.74X 0.43 0.31 05 06Roseng 0.60X 0.20 0.42 0.15 03 07Berger -0.10 0.58X 0.21 0.31 09 08Barcus 0.31 0.39 0.35 0.17 32 09Linné 0.01 0.43 0.35 0.36 33 10Pool 0.22 0.62X 0.25 0.12 07 11Himmel 0.14 0.48X 0.24 0.30 13 12Beinst 0.14 0.56 0.64X 0.15 17 13Pisare 0.75X -0.15 -0.32 0.05 01 14Maletz -0.20 0.42 0.17 0.55X 26 15Nakaji 0.20 0.33 0.33 0.53X 27 16Sicins 0.43 0.37 0.45X 0.23 23 17Kato -0.11 0.53X 0.35 0.44 12 18Lyle 0.34 0.13 0.17 0.75X 24 19Lerg 0.20 0.36 0.41 0.44 34 20Escarp 0.20 0.27 0.20 -0.13 35 21Rühl 0.08 0.43 0.55X 0.12 21 22Tanaka 0.27 0.45X 0.03 0.25 15 23Goyer 0.29 0.35 0.59X 0.15 18 24Uno 0.37 -0.01 0.36 0.45X 30 25Mestro 0.69X 0.43 -0.08 0.20 02 26Kubin 0.47X 0.17 -0.17 0.35 04 27Campea 0.07 0.28 0.04 0.15 36 28McQuai -0.02 0.62X 0.30 0.23 08 29Barbic 0.31 0.40 -0.22 0.43 37 30Singh 0.14 0.37 0.56X 0.37 20 31Brown 0.18 0.02 0.17 0.47X 28 32Dajani 0.46 0.50 0.25 0.29 38 33Berlo 0.07 0.52 0.58X -0.05 19 34Koning 0.40 0.16 0.43 0.47X 29 35Lazars 0.29 0.22 0.48X 0.23 22 36Cherry 0.26 0.58X 0.41 0.26 10 37Noelle 0.28 0.48X 0.13 -0.09 14 38WS1975 0.00 0.22 0.65X 0.28 16 ------------------------------------------------- Table 8: Factor Scores - "Theoretical" Q-Sorts for Factors A, B, C, D (based on Barchak, 1977, table 3-8) Factors No. A B C D 1 0 4 3 0 2 -3 -2 0 0 3 3 0 -1 0 4 0 -3 0 1 5 2 -1 -2 0 6 2 3 4 4 7 3 1 1 0 8 -2 0 -4 -1 9 -2 3 5 3 10 2 4 2 5 11 -3 0 1 1 12 -2 0 0 1 13 0 -1 0 3 14 -5 -3 -3 -3 15 -1 1 -1 1 16 0 -4 -2 -2 17 1 -1 0 -2 18 1 -1 -2 -3 19 -1 -2 0 -4 20 -3 -4 -5 -5 21 1 0 1 -3 22 3 -1 -3 2 23 -1 0 -1 -2 24 -1 2 -1 2 25 -2 5 4 -2 26 1 1 3 4 27 4 -2 -1 -1 28 0 1 2 -1 29 1 2 1 2 30 4 2 2 3 31 -4 1 2 0 32 -4 -5 -4 -4 33 0 -2 -2 -1 34 5 2 1 2 35 2 3 3 1 36 -1 -3 -3 -1 ------------------------------------------------- Table 9: Additional Q-sort data arrays (in 'PQMethod format') FactorA - FactorD: see Table 8 above WS1977, WS1984: Stephenson's 2nd and 3rd sorts (from Barchak, 1997) smk: my own sort of the KOC statements ...: additional participants' sorts may be added when available. FactorA 0-3 3 0 2 2 3-2-2 2-3-2 0-5-1 0 1 1-1-3 1 3-1-1-2 1 4 0 1 4-4-4 0 5 2-1 FactorB 4-2 0-3-1 3 1 0 3 4 0 0-1-3 1-4-1-1-2-4 0-1 0 2 5 1-2 1 2 2 1-5-2 2 3-3 FactorC 3 0-1 0-2 4 1-4 5 2 1 0 0-3-1-2 0-2 0-5 1-3-1-1 4 3-1 2 1 2 2-4-2 1 3-3 FactorD 0 0 0 1 0 4 0-1 3 5 1 1 3-3 1-2-2-3-4-5-3 2-2 2-2 4-1-1 2 3 0-4-1 2 1-1 WS1977 -1 0-1-1-4 3 0 0 4 5 1 1-2-3 2-3-2 2-2-4-1-3-2 0 3 4 1 2 1 1 3 0 0-1 2-5 WS1984 1 1-2 2-2 3 0 4 1 4 0 0 0-3-1-3-1 0-3-5-2-1-4 1 1 5-4-1 3 2 3-2 2 0 2-1 smk 0-3-2 2-4 2 3-1 3 1 1 0 0-2 2-4-1-2-2-3 0-1 1 4 3 4-1 0 5 2 1-3-1 1 0-5