Save the Data  Survey Dos and Don’ts

Save the Data Survey Dos and Don’ts


>>I DID START THE RECORDING. HELLO, EVERYONE. WE ARE HERE TODAY TO DISCUSS SURVEY METHODOLOGY, OR ESSENTIALLY TO MAKE IT SOUND A LITTLE LESS SCARY, SURVEY DOS AND DON’TS, SO TODAY I HAVE WITH ME JOE HAMLIN, THE LIBRARY DATA COORDINATOR, AND I AM KATHY KOSINSKI, THE STATEWIDE LIBRARY SERVICES ANALYST, WE BOTH WORK AT THE LIBRARY OF MICHIGAN, WHICH IS THE STATE LIBRARY OF MICHIGAN, LOCATED IN LANSING. SUPER FUN.>>ABSOLUTELY, AND WE DIDN’T SAY THIS AT THE BEGINNING, BUT WELCOME TO SAVE THE DATA WEBINAR NUMBER NINE. SO WE HAVE 12 SCHEDULED SO FAR, AND WE ARE ALWAYS LOOKING FOR YOUR INPUT ON THINGS YOU WOULD LIKE TO DISCUSS, OR-OR HAVE US COVER, SO PLEASE KEEP THAT IN MIND. HI, JENNIFER, DID YOU HAVE A QUESTION, OR WERE YOU RESPONDING TO THE RAISE YOUR HAND COMMENT?>>SO, SPEAKING OF JOE SAYING THAT WE LIKE TO GET FEEDBACK, PLEASE, PLEASE, PLEASE FILL OUT OUR SURVEY. PART OF THE REASON WHY WE’RE ABLE TO DO THIS IS WE RECEIVE FUNDING FROM IMLS, AND TO DO THAT, WE NEED TO PROVIDE THEM FEEDBACK. AND FOR US TO DO THAT, WE NEED YOU TO PROVIDE US WITH FEEDBACK, AND WE ALSO HAVE A QUESTION HERE, WHICH IS REALLY FUN, THAT IS, “WHAT WOULD YOU LIKE “TO LEARN MORE ABOUT?” SO THE SAVE THE DATA IS ESSENTIALLY GOING THROUGH ALL THE DIFFERENT TYPES OF SURVEY– OR NOT, SORRY, SURVEY– RESEARCH DATA THAT LIBRARIES BOTH COLLECT AND CREATE ON THEIR END, SO WE’RE KIND OF TRYING TO GET DOWN TO THE BASICS AND MAKE EVERYONE FEEL MORE COMFORTABLE WITH DATA. JOE, COULD YOU DO ME A FAVOR AND MUTE YOUR MIC, BECAUSE I CAN HEAR MYSELF TALKING, LIKE A TINY VOICE IN MY HEAD.>>HOW’S THAT?>>MUTE IT.>>I THOUGHT YOU SAID “MOVE MY MIC.”>>NO, NO, NO.>>YEAH, I CAN MOVE IT.>>YEAH, WE’RE GETTING SOME FEEDBACK. OKAY. THANK YOU. THERE WE GO, SO I GUESS THE VERY FIRST QUESTION THAT WE REALLY WANT TO REACH AND GET TO IS WHEN DO I MAKE A SURVEY? BECAUSE THERE TENDS TO BE THIS KNEE JERK REACTION AND– I WON’T SAY SOCIETY TODAY, BUT ESPECIALLY IN LIBRARIES, FOR PEOPLE TO JUST THROW OUT SURVEYS SEEMINGLY JUST BECAUSE. THIS UNFORTUNATELY LEADS TO SURVEY FATIGUE IN MANY OF OUR PATRONS, MEMBERS, CUSTOMERS, WHICHEVER WORD YOU LIKE TO USE, AND IT’S SOMETHING THAT WE ALSO KIND OF RUN ACROSS ON OUR OWN AS WELL. YOU SEE– YOU KNOW, YOU SEE A SURVEY, MAYBE AT THE BEGINNING OF THIS PRESENTATION, FOR EXAMPLE, AND JUST GET THAT INTERNAL, “OH, NO, “NOT AGAIN,” OR YOU JUST SKIP IT COMPLETELY. AND BECAUSE OF THIS– BECAUSE OF THIS SURVEY FATIGUE, I’M GOING TO START OFF THIS PRESENTATION WITH THE STICK RATHER THAN THE CARROT, AND THAT IS… WHEN YOU SHOULDN’T MAKE A SURVEY. AND ESSENTIALLY, YOU SHOULDN’T MAKE A SURVEY– I’M GOING TO READ THROUGH THESE REALLY QUICKLY– IF YOU DON’T WANT OR NEED TO MEASURE ANYTHING. IF YOU DON’T HAVE A PLAN ON THE BEST WAY TO SHARE IT. IF YOU REALLY ONLY NEED TO HEAR FROM A FEW PEOPLE, OR IF YOU’RE UNABLE TO TEST THE SURVEY. DON’T WORRY, THIS IS NOT THE EXTENT OF IT. I’M GOING TO GO IN DEEPER WITH ALL OF THESE, BUT THE REASON FOR ALL OF THIS IS A SURVEY SHOULD NOT EXIST IN A VACUUM. A LOT OF THE SURVEYS THAT ARE SENT OUT INTO THE WORLD TODAY ARE SOMETHING WHERE THEY MAKE IT, IT GOES OUT, THEY NEVER FIX IT. IT JUST SORT OF EXISTS AS IT’S OWN THING, AND OFTEN A LOT OF PEOPLE DON’T GO THROUGH ALL THE DATA THAT THEY RECEIVE AT THE SAME END, SO IT’S JUST PEOPLE TAKING SURVEYS JUST FOR THE SAKE OF THERE BEING A SURVEY, AND SAYING THAT YOU TOOK A SURVEY. SO IN ORDER TO MAKE SURE YOUR SURVEY DOESN’T EXIST IN A VACUUM, YOU SHOULD WORK THROUGH AND ESTABLISH WHAT YOU WANT TO MEASURE, IDENTIFY YOUR TARGET GROUP. YOU KNOW, FIGURE OUT HOW WILL YOU REACH THEM, BECAUSE THE QUESTIONS YOU WRITE AND HOW YOU WRITE THE QUESTIONS WILL BE REALLY DETERMINED BY THE WAY THAT YOU’RE GOING TO SEND IT OUT TO PEOPLE. YOU’RE NOT GOING TO DO, YOU KNOW, LONG ANSWER RESPONSES IF IT’S GOING TO BE A CELL PHONE SMS POLL. YEAH, IT’S JUST NOT GOING TO WORK OUT IN THE SAME WAY. YOU SHOULD WRITE YOUR FIRST DRAFT, TEST IT, AND THEN YOU SHOULD MONITOR IT WHEN YOU WORK IT OUT, AND I-I SAY ALL THESE THINGS BECAUSE THERE IS NO ALL-ENCOMPASSING PERFECT SURVEY. EVERYTHING’S GOING TO CHANGE DEPENDING ON THESE FIVE DIFFERENT METHODS OF, YOU KNOW, CREATING A SURVEY. IT’S– EVEN IF YOU DO EVERYTHING THAT YOU THINK IS PERFECT AT IT, YOU MAY NOT END UP WITH WHAT ENDS UP BEING A PERFECT SURVEY, WHICH IS WHY YOU NEED TO DO FOUR AND FIVE AGAIN, AND AGAIN, AND AGAIN, TO GET CLOSER TO THE MOST PERFECT SURVEY. SO THE FIRST ONE OF THESE IS DO. DO, DO, DO, PLEASE FIGURE OUT WHO YOU WANT TO HEAR FROM. YOU NEED TO HAVE YOUR AUDIENCE IN MIND WHEN YOU DO THIS, OR ELSE YOU’RE GOING TO TRY AND GET SOMETHING THAT COVERS EVERYONE BUT IT’S NOT GOING TO WORK FOR ANYONE IF YOU END UP WITH SOMETHING LIKE THAT, SO YOU NEED TO FIGURE OUT WHO YOU WANT TO HEAR FROM, AND WHEN YOU’RE LOOKING AT THAT GROUP OF PEOPLE, YOU NEED TO DETERMINE, ARE THEY A LARGE ENOUGH POPULATION OR SAMPLE THAT YOU CAN SEND A SURVEY OUT TO. IF IT’S ONLY A HANDFUL OF PEOPLE, FOR EXAMPLE, THE SECOND ONE WE HAVE HERE, FEEDBACK ON THE CONTENT OF CURRENT STORY TIMES BY THE REGULAR ATTENDEES, AN INTERVIEW OR JUST A CASUAL CONVERSATION MAY BE BETTER THAN SHOVING ANOTHER SURVEY IN THEIR FACE. IF IT’S A LOT OF PEOPLE YOU NEED TO REACH OUT TO, IF IT’S SOMEONE YOU DON’T HAVE EASY ACCESS TO FOR AN INTERVIEW, OR MOST IMPORTANTLY, IF IT’S SOMETHING THAT ABSOLUTELY NEEDS TO BE ANONYMOUS, A SURVEY IS GOING TO BE A MUCH BETTER BET FOR YOU TO GO. AND THEN, AS I SAID BEFORE, YOU NEED TO DECIDE HOW YOU WILL SHARE THE SURVEY BEFORE YOU WRITE IT, AND ONE OF THE BIGGEST THINGS I’M GOING TO SAY IS FOR DECIDING WHICH WAY YOU WANT TO SHARE IT, IS WILL SOCIAL DESIRABILITY HAVE A BIG IMPACT ON THE RESULTS? PEOPLE LIKE TO BE LIKED BY OTHER PEOPLE. YOU DON’T WANT TO BE SEEN AS A MEAN PERSON, SO IF SOMEONE COMES UP AND ASKS, “HEY, “AM I DOING A GREAT JOB?” YOU’RE MORE LIKELY TO SAY YES, EVEN IF YOU DON’T THINK IT, BECAUSE IT’S IN PERSON, SO THAT GOES BACK TO WHO DO YOU WANT TO TARGET AND WHAT ARE YOU TRYING TO MEASURE? HOW GREAT A PROGRAM WAS IS SOMETHING YOU MAY WANT TO DO MORE ANONYMOUS AND HAVE A PAPER SURVEY OR A DIGITAL SURVEY, SOMETHING WHERE IT ISN’T FACE TO FACE, WHEREAS GOOD TIMES FOR A PROGRAM IS SOMETHING YOU CAN DO FACE TO FACE, OVER THE PHONE, THINGS LIKE THAT, BECAUSE IT’S MORE BY THE BOOK AND LESS TOUCHY-FEELY WITH HOW YOU’RE DOING IT, AND THEN YOU ALSO HAVE TO THINK ABOUT HOW MUCH TIME DO YOU HAVE TO ADMINISTER THE SURVEY. IF IT’S AN IN PERSON, ASKING PEOPLE ON THE STREET WITH A CLIPBOARD, THAT REQUIRES A LOT STAFF TIME. IF YOU’RE DOING IT TO COMPLETE DATA ENTRY, PAPER SURVEYS, OBVIOUSLY THAT’S GOING TO TAKE MORE TIME TO INPUT THE DATA BACK INTO WHICHEVER SPREADSHEET OR PROGRAM YOU’RE USING TO DO THAT. AND THEN, ULTIMATELY TO FINISH THE DATA COLLECTION. IT’S– IF YOU’RE DOING, YOU KNOW, SOMETHING WHERE YOU NEED ANSWERS BY THE END OF THE DAY, DIGITAL IS PROBABLY BETTER THAN A MAIL SURVEY. AND THEN, ONCE AGAIN, DO YOU NEED IT TO BE ANONYMOUS? SORRY, JOE?>>[ INDISTINCT ].>>SORRY, JOE IS STILL MUTED, BUT HE WANTED TO TALK ABOUT THE AUDIENCE AS WELL, SO–>>RIGHT, KATHY MENTIONED A DIGITAL SURVEY. DO KEEP IN MIND WHEN YOU– YES, YOU’RE AFTER FAST RESULTS AND YOU’LL GET THEM WITH A DIGITAL SURVEY, BUT YOU’RE ONLY GETTING A SMALL SEGMENT OF YOUR POPULATION, PROBABLY– PROBABLY A PRETTY GOOD SIZED SEGMENT OF YOUR POPULATION AT THIS POINT, ‘CAUSE EVERYONE’S GOT A SMART PHONE, EVERYONE’S, YOU KNOW, GOT A COMPUTER OR A TABLET, OR MOST EVERYONE, BUT YEAH, WHEN YOU MAKE THOSE DECISIONS, IF YOU’RE GOING TO GO WITH A SINGLE TYPE OF SURVEY INSTRUMENT, LOOK AT WHO YOUR AUDIENCE IS THAT YOU’RE AIMING FOR, AND MAKE SURE THAT IT’S A TOOL THAT THEY CAN USE. THAT WAS MY TWO CENTS.>>THANK YOU, AND-AND YES, WHERE YOU SHARE THAT OUT, SO IF IT’S A DIGITAL SURVEY, A, YOU KNOW, IF YOU SEND IT OUT VIA E-MAIL TO A BUNCH OF PEOPLE ON A LIST SERV, THAT MIGHT GET A DIFFERENT RESPONSE THAN IF YOU JUST POST IT ON YOUR WEBSITE. AND REALLY, EVERY LITTLE EFFECT, IT’S LIKE A SERIES OF DOMINOS, CAN CHANGE THE SORT OF ANSWERS YOU GET, AND THE SORT OF RESPONSES YOU GET. IF IT’S SENT OUT FROM SOMEONE WHO MAYBE HAS MORE CLOUT IN THE COMMUNITY, YOU MIGHT GET A HIGHER RESPONSE THAN IF YOU HAVE THE INTERN SEND IT OUT. AT THE SAME TIME, IF YOU’RE TRYING TO INTERVIEW TEENS, MAYBE GETTING ANOTHER TEEN TO RUN THE SURVEY WILL GET MORE HONEST RESPONSES THAN IF YOU HAVE THE DIRECTOR OF THE LIBRARY DO IT. THERE’S A LITTLE BIT OF GIVE AND TAKE FOR EVERYTHING, AND THEN, FINALLY, DO YOU NEED IT TO BE ANONYMOUS? WITH MOST OF THESE, WITH PRIVACY AND EVERYTHING INVOLVED, I LEAN TOWARDS DOING ANONYMOUS IF– WHENEVER POSSIBLY, BUT IF IT IS, ONCE AGAIN, SOMETHING WHERE I JUST WANT TO GET THE FEEDBACK OF, YOU KNOW, CHUCK, TINA, AND ALAN FROM THE STORYTIME SESSIONS, MAYBE IT’S NOT SOMETHING THAT NEEDS TO BE ABSOLUTELY ANONYMOUS. SO, JUST HOW YOU’RE GOING TO BE DOING THAT ALSO DETERMINES WHAT YOU’RE DOING, AND I KIND OF RUN THROUGH THESE FOR– THESE ARE ALL TAKEN FROM HANDOUTS FROM THE RESEARCH INSTITUTE FOR PUBLIC LIBRARIES, WHICH IS A GREAT CONFERENCE I HIGHLY RECOMMEND TO EVERYONE, BUT THEY HAD MODES OF ADMINISTRATION FOR SURVEYS, HANDOUTS, AND THESE HAVE THE PROS AND CONS FOR ALL THE DIFFERENT TYPES OF FORMATS, THERE’S ONLINE, WHICH, ONCE AGAIN, IT CAN BE ANONYMOUS. YOU DON’T HAVE TO WORRY AS MUCH ABOUT THE SOCIAL DESIRABILITY BIAS. AND IT HAS A LOT OF QUICK, SORT OF, GIVE AND TAKE FOR DATA ENTRY AND COLLECTION. THE CONS, ONCE AGAIN, YOU HAVE NO OPPORTUNITY TO CLARIFY. THIS IS ONE THAT ACTUALLY KIND OF CAME BACK TO ATTACK ME ONE DAY. I USED THE TERM POST-MILLENNIAL IN A SURVEY FOR– WE WERE TRYING TO GAUGE DIFFERENT GENERATIONS, AND A LOT OF PEOPLE, BECAUSE IT IS, YOU KNOW, JARGON, AN OBSCURE TERM FOR MANY PEOPLE, SAW THAT NOT AS PEOPLE BORN AFTER THE GENERATION OF MILLENIALS, AKA YOUNGER THAN MILLENIALS, AND INSTEAD THEY SAW IT AS EVERYONE WHO IS OLDER THAN MILLENIALS, SO IT SKEWED THE DATA RESULTS, AND IT WASN’T SOMETHING THAT WE COULD HAVE THE FACE TO FACE INTERACTION TO CLARIFY FOR THAT. IT’S ALSO, AS JOE SAID, LIMITED TO ONLINE USERS, SO IF YOU HAVE SOMEONE WHO DOESN’T HAVE AN INTERNET CONNECTION, DOESN’T HAVE A SMART PHONE, YOU’RE NOT GOING TO HEAR THEIR VOICE. SMS AND TEXT, THESE ARE BECOMING MORE AND MORE POPULAR. I SEE LESS FOR COMPLETE SURVEYS AND MORE FOR POLLS, MAYBE, BEFORE AND AFTER WORKSHOPS. YOU HAVE A NUMBER, YOU CAN SET IT UP WITH A-A NICE LITTLE ONLINE SOFTWARE PLATFORM AND YOU CAN HAVE PEOPLE TEXT THEIR ANSWER TO A NUMBER, AND USUALLY YOU CAN GIVE THEM AN ABC, THINGS LIKE THAT. IT CAN BE ANONYMOUS IF YOU HAVE A LARGE ENOUGH GROUP. IT’S KIND OF AWKWARD IF THERE’S ONLY ABOUT FOUR OR FIVE OF YOU AND THEY CAN SEE YOU TYPING, AND THEN YOU SEND YOUR ANSWER, AND THEN IT’S NOT SO ANONYMOUS BECAUSE EVERYONE KNOWS YOU’RE THE ONE WHO SAID A. SO THERE IS– DEPENDING ON HOW YOU DO IT, IT CAN BE GOOD. ONCE AGAIN, IT’S LIMITED TO CELL PHONE NUMBER– USERS. KIND OF CHANGES THE SORT OF QUESTIONS YOU CAN ASK. THINGS LIKE THAT. AND I’M GOING TO ALSO SAY, AS WE’RE DOING THIS, I HAVE THIS– I DON’T HAVE THIS– ALL THE INFORMATION IS HERE. BUT IF YOU WOULD LIKE INFORMATION, LIKE, THE FULL HANDOUT, I CAN GIVE THAT TO YOU AS WELL. JUST SIMPLY GIVE ME AN EMAIL. OUR EMAILS ARE AT THE BOTTOM OF EACH SLIDE. IN PERSON, THIS IS ANOTHER ONE WHERE IT’S, AS YOU CAN EXPECT, FACE TO FACE, MODERATE SPEED OF DATA COLLECTION. IT’S HIGHLY DEPENDENT ON YOUR STAFF TIME, DEPENDING ON DATA– DATA ENTRY CAN CHANGE. THIS HAS IT LISTED AS A CON, BUT IF YOU’RE, FOR EXAMPLE, WALKING AROUND, INSTEAD OF WITH A CLIPBOARD, WITH AN iPAD, YOU CAN AUTOMATICALLY PUT IT RIGHT IN. SO IT REALLY CHANGES IT AROUND, BUT THERE REALLY IS A LACK OF ANONYMITY AND ONCE AGAIN, YOU HAVE THAT FACE TO FACE INTERACTION. PEOPLE ARE GOING TO TRY TO BE NICE TO YOU, SO YOU GET THAT. YOU HOPE, YEAH, YOU HOPE THEY’RE GOING TO BE NICE TO YOU. IT’S PROBABLY A BAD SIGN IF PEOPLE ARE GOING TO BE REALLY NASTY TO YOUR FACE. THEN SOMETHING MIGHT BE HAPPENING, BUT– AND THEN MAIL, MAIL IS A FUN ONE. IT’S– YOU CAN POTENTIALLY REACH ALL OF THE PEOPLE IN A GEOGRAPHIC AREA. ONCE AGAIN, YOU ALWAYS HAVE THAT BIAS OF PEOPLE CHOOSE TO ANSWER SURVEYS. YOU’RE NOT GOING TO FORCE THEM INTO IT. MAYBE WITH THE CENSUS, BUT THAT’S PRETTY MUCH IT. THERE’S MANY TYPES OF QUESTIONS THAT YOU ONCE AGAIN CAN’T CHANGE THEM AFTER THE FACT. IF SOMEONE GETS CONFUSED IF SOMEONE IS UPSET ABOUT SOMETHING, YOU KNOW, THERE’S NO WAY TO TELL THEM AND FIX– YOU KNOW, TELL THEM EXACTLY WHAT YOU MEAN BY THAT QUESTION. AND I THINK THE BIGGEST CON FOR THIS ONE IS POSTAGE IS COSTLY, ESPECIALLY DEPENDING ON THE AMOUNT OF PEOPLE YOU WANT TO REACH. IF YOU’RE REACHING EVERY SINGLE PERSON IN YOUR SERVICE AREA, IT-IT CAN GET EXTREMELY EXPENSIVE REALLY QUICKLY. AND THEN– OH, I ACTUALLY LEFT IT OUT, BECAUSE THERE’S ONE MORE, AND IT IS A PHONE SURVEY. AND I LEFT IT OUT BECAUSE IT’S… THERE’S I THINK… THERE’S SO MANY CONS TO IT THAT, WHILE I WILL SAY THAT YOU SHOULD BE AWARE THAT PHONE SURVEYS ARE A METHOD, YOU DON’T HAVE THE ANONYMITY, PEOPLE ARE LESS LIKELY TO COMPLETE IT IF THEY HAVE PHONE ANXIETY OR THINGS RELATED TO THAT. IT CAN BE EXTREMELY COSTLY, WHETHER IT’S FOR STAFF TIME, OR WHETHER YOU HIRE IT OUT TO SOMEONE ELSE, AND IT CAN HAVE ALL OF THE OTHER CONS OF PRETTY MUCH EVERY OTHER SORT OF SURVEY THAT WE WENT THROUGH, WHERE YOU CAN’T CHANGE IT, THE ANSWERS ARE LIMITED. I WENT THROUGH AN ENTIRE POLITICAL PHONE SURVEY ONE TIME WHERE IT WAS A COMPUTER ON THE OTHER END AND NOT A PERSON, AND IT NEVER– IT WAS FOR A SPECIFIC POLITICAL PARTY, AND THEY NEVER ASKED ME IF I WAS GOING TO BE VOTING FOR THE OTHER POLITICAL PARTY. THEY JUST SAID WHICH CANDIDATE ARE YOU GOING TO VOTE FOR AND LISTED THEIRS, SO IT’S ONE OF THOSE ISSUES WHERE, ONCE AGAIN, IT LIMITS WHAT YOU’RE DOING. SO THE NEXT DO– TEST AND REFINE YOUR WORK. I– AS I SAID EARLIER, I HAD THAT ISSUE WITH THE POST MILLENNIAL QUESTION THAT I HAD GOING ON, AND THIS WAS AN EXAMPLE OF WHERE I TESTED IT WITH CO-WORKERS AND I TESTED IT WITH OTHER PEOPLE IN LIBRARIES, WHICH IS REALLY GOOD, BUT I DIDN’T HAVE A CHANCE TO TEST IT WITH THE ACTUAL GROUP OF PEOPLE THAT WE WERE SURVEYING, SO ONCE WE DID GET THAT GOING OUT IN THE SAMPLE, I WAS ABLE TO GO BACK AND CHANGE THE QUESTION WITH THE WORDING SO I HAD THE BIRTH YEARS NEXT TO EACH GENERATION FOR WHAT IT WAS DOING, AND THAT ALLOWED US, AFTER THAT ROUND OF ITERATION, TO START GETTING THE CORRECT ANSWERS AND BETTER QUESTIONS OF WHAT WAS GOING ON. AND AS YOU CAN IMAGINE, FOR THAT CASE, IT WAS JARGON, BUT REGARDLESS OF HOW YOU DO IT, YOU’LL NEVER REALLY KNOW HOW PEOPLE ARE GOING TO RESPOND, SO IF YOU’RE NOT SURE WHAT’S HAPPENING, I HAVE PUT TOGETHER THIS LOVELY LIST WITH THE HELP, ONCE AGAIN, OF THE RESEARCH INSTITUTE FOR PUBLIC LIBRARIES, OF HOW TO WRITE CLEAR CUT QUESTIONS. SO THE FIRST ONE IS USE EVERYDAY VOCABULARY. DON’T– WE FALL INTO THIS QUITE A BIT IN LIBRARIES. WE SAY CIRCULATION. WE USE JARGON AND ACRONYMS, SO WE HAVE ALL THESE OTHER FUN THINGS. I SUGGEST IF YOU REALLY WANT TO TRY AND USE EVERYDAY VOCABULARY, BECAUSE ONCE AGAIN, WE ALSO FORGET. WE, YOU KNOW, WE’RE PRETTY EDUCATED PEOPLE. WE FORGET WHAT EVERYDAY VOCABULARY IS. I HIGHLY RECOMMEND USING THE HEMINGWAY APP. IT’S A FREE WEBSITE. YOU CAN JUST GOOGLE– I THINK IT’S HEMINGWAYAPP.COM, BUT I’D GOOGLE IT JUST TO BE SURE. IT GIVES YOU THE GRADE LEVEL OF THE– OF WHAT, YOU KNOW, WHAT YOU’RE WRITING, WHAT IT IS. WHEN WE’RE REDOING THE MICHIGAN E-LIBRARY WEBSITE RIGHT NOW, AND WE’RE USING THAT FOR ALMOST EVERY SINGLE PAGE. IT’S BEEN EXTREMELY HELPFUL, ESPECIALLY WITH THE KIDS’ PAGES. SO IF YOU’RE, YOU KNOW, DOING A SURVEY WITH KIDS, OR DOING A SURVEY WITH YOUNGER GRADES, OR MAYBE A LITERACY CLASS FOR ADULTS, YOU WANT TO MAKE SURE THAT WHAT YOU’RE ASKING THEM ISN’T OUT OF THEIR RANGE. AND AGAIN– THEN AGAIN, JARGON AND ACRONYMS. DON’T SAY, LIKE, OPACS, JUST SAY “PUBLIC COMPUTERS.” THINGS LIKE THAT. AVOID WORDING THAT IS AMBIGUOUS OR UNCLEAR. THAT ESPECIALLY HAPPENS WHEN YOU COMBINE IT WITH THE NEXT ONE, WHERE IT’S– YOU HAVE MORE THAN ONE IDEA IN EACH QUESTION. FOR EXAMPLE, HOW OFTEN DO YOU ATTEND STORYTIME AND PUPPET SHOWS AT THE LIBRARY? WELL, WHAT IF THEY ONLY ATTEND STORYTIMES AND THEY HAVE NEVER ATTENDED A PUPPET SHOW, BUT THEY ATTEND EVERY SINGLE STORYTIME THAT’S POSSIBLE? IT’S GOING TO CHANGE AND SKEW THE ANSWERS, SO JUST MAKE SURE YOU’RE ABSOLUTELY CLEAR WITH WHAT YOU’RE SAYING, AND THAT YOU LIMIT IT TO ONE IDEA PER QUESTION, SO SPLIT THAT ONE THAT I JUST GAVE INTO TWO. HOW OFTEN DO YOU ATTEND STORYTIMES, AND HOW OFTEN DO YOU ATTEND PUPPET SHOWS. NOW THIS NEXT ONE, IT’S– IT’S A LITTLE CONTROVERSIAL, JOE. IT’S A LITTLE CONTROVERSIAL. IT’S ASK MOSTLY CLOSED-ENDED QUESTIONS. SO FOR SURVEYS, IF YOU REALLY WANT TO GET… THE BEST BANG FOR YOUR BUCK IN TERMS OF SPEED OF EVALUATING AND COMPLETION, YOU’RE GOING TO WANT TO ADD– ASK MOSTLY THE CLOSED-ENDED, AND THIS IS IF YOU’RE DOING SOMETHING LIKE AN SMS POLL, YOU DEFINITELY WANT TO ASK CLOSED-ENDED QUESTIONS. IT’S PRETTY MUCH THE ONLY THING YOU CAN DO, BUT I WOULD SAY, LEAVE SOME OPEN-ENDED QUESTIONS. IT WILL ESPECIALLY HELP WITH SOME OF THE, YOU KNOW, IF THERE’S MULTIPLE OPTIONS, OR YOU WANT TO MAKE SURE THAT EVERYONE’S ACCOUNTED FOR. ONE OR TWO AT THE END IS PROBABLY FOR THE BEST. JOE?>>CAN YOU GIVE US AN EXAMPLE OF CLOSED-ENDED VERSUS OPEN-ENDED QUESTIONS?>>OH.>>BECAUSE YOU’RE USING JARGON.>>YES, I AM USING JARGON. UGH, THIS IS SO EMBARRASSING. I SHOULD JUST– UGH. I’M GOING TO GO SIT IN A QUIET ROOM AFTER THIS AND THINK ABOUT MY CHOICES. SO A CLOSED ENDED QUESTION WOULD BE WHICH PENINSULA DO YOU LIVE IN THE U– IN, WOW, IN THE STATE OF MICHIGAN? A. UPPER PENINSULA, B. LOWER PENINSULA. AN OPEN-ENDED QUESTION WOULD BE SOMETHING WHERE YOU SAY, “WHICH PENINSULA DO YOU LIVE IN IN THE– YOU KNOW, THE STATE OF MICHIGAN?” AND YOU JUST LEAVE A TEXT BOX, AND THIS CAN GIVE YOU SOME… INTERESTING ANSWERS, I WILL SAY. I TRIED TO MAKE A QUESTION ONCE WHERE IT WAS ESSENTIALLY A CLOSED ENDED QUESTION. IT WAS HOW LONG HAVE YOU BEEN WORKING ON LIBRARY BOARDS, AND I GAVE THEM A LIST OF OPTIONS FOR THAT, SO I HAD ZERO TO NINE YEARS, TEN TO 19 YEARS, ETCETERA. I ALSO HAD AN “OTHER” BUTTON FOR PEOPLE WHO, YOU KNOW, FELL OUTSIDE OF THE REALM OF THE RANGE OF DATES I HAD, WHICH I THOUGHT WAS ALL-ENCOMPASSING, BUT YOU NEVER– YOU NEVER KNOW. MAYBE SOMEONE JUST JOINED THE BOARD, WHICH YOU THINK WOULD BE ZERO TO NINE, BUT IT’S NOT. I HAD 54% OF ONE POPULATION, I’M NOT GOING TO SAY WHO, CLICKED OTHER, AND THEN WROTE, “SEVEN” IN.>>YEP, OOPS.>>YEP, YEP, YEP. SO THAT WOULD BE AN EXAMPLE OF, AND I’M GOING TO GO OVER THIS KIND OF BRIEFLY LATER ON, BUT MAKE SURE IF YOU DO OFFER THE OTHER IT’S TO ACCOUNT FOR EVERYONE, AND THAT IT’S SOMETHING WHERE YOU HOPEFULLY WON’T HAVE TO GO BACK AND RECODE EVERYTHING TO MAKE IT FIT. SO I HAD TO GO BACK, AND I HAD TO, YOU KNOW, ENTER– SWITCH IT, SO INSTEAD OF SAYING SEVEN IT SAID ZERO TO NINE, SO I COULD ACTUALLY GET VIABLE RESULTS FOR MY QUESTION. OH, THIS IS A FUN ONE, THOUGH. AVOID BIAS IN THE WORDING OF YOUR QUESTIONS AND ANSWER CHOICES. POLITICAL SURVEYS, REGARDLESS OF PARTIES, LOVE DOING THIS. THEY’RE LIKE, YOU KNOW, HOW GREAT A JOB IS THE PRESIDENT DOING TODAY? AND IT’S LIKE, “WONDERFUL, “EXCELLENT, FANTASTIC,” NO OTHER CHOICES THAT YOU HAVE GOING ON, THERE, WHICH, ONCE AGAIN LEAVES YOU TO– MY COMPUTER SCREEN JUST FELL ASLEEP, THIS IS GREAT. OKAY, MAKE SURE THERE IS AN ANSWER CHOICE FOR EVERYONE. EV– I WILL GUARANTEE EVERY SINGLE PERSON LISTENING TO THIS HAS RUN ACROSS A SURVEY IN THEIR LIFE WHERE THEY HAVE RESPONDED WITH, “I DON’T FIT INTO ANY “OF THESE CATEGORIES.” THIS ISN’T RIGHT. AND IT MAKES YOU KIND OF FEEL UNCOMFORTABLE. YOU EITHER TRY TO FIGURE OUT, “OH, MAYBE I FIT HERE, “MAYBE I DON’T FIT HERE.” OR YOU JUST SKIP IT COMPLETELY. SO IF– JUST TO MAKE EVERYONE FEEL WELCOME, THAT WOULD BE A GOOD PLACE TO HAVE THE OTHER, AND THEN THIS ONE, YOU’D THINK IS KIND OF RELATED, ONCE AGAIN, TO THE POLITICAL SURVEY ONE, IS MAKE SURE RATING SCALES HAVE AN EQUAL NUMBER OF POSITIVE AND NEGATIVE CHOICES. IF YOU HAVE TWO POSITIVES, MAKE SURE YOU HAVE TWO NEGATIVES. THE JURY IS OUT ON WHETHER YOU NEED TO HAVE A NEUTRAL ONE IN THE MIDDLE. SOME PEOPLE REALLY LOVE HAVING THAT NEUTRAL THERE FOR PEOPLE THAT REALLY DON’T CARE. OTHER PEOPLE THINK THAT YOU SHOULD FORCE PEOPLE INTO A POSITIVE OR NEGATIVE. IT ISN’T–>>OH, I’M SORRY, I’M-I’M ONE OF THE NEUTRAL PEOPLE.>>YOU LIKE–>>I THINK THAT NEEDS TO BE THERE, JUST TO SHOW IF I’M MEASURING A DATA ELEMENT, AND PEOPLE ARE COMPLETELY APATHETIC ABOUT IT, I WANT TO KNOW THAT, TOO.>>MM-HMM, BUT IF YOU’RE– IF YOU’RE DOING SOMETHING WHERE YOU ABSOLUTELY, FOR EXAMPLE, KNOW YOU– YOU EITHER WANT TO MAKE A CHANGE, OR YOU DON’T WANT TO MAKE A CHANGE, AND IT– THERE IS NO NEUTRAL GROUND, YOU HAVE TO KIND OF FORCE PEOPLE INTO THAT. FOR EVERYTHING THAT WE DO AT THE LIBRARY OF MICHIGAN, I AM ACTUALLY DOING THE NEUTRAL, BECAUSE IT TIES IN EASILY WITH THE IMLS QUESTIONS. IMLS USES THE NEUTRAL, SO ONCE AGAIN, YOU SHOULD ALSO TAKE A LOOK AT THE OTHER THINGS THAT YOU’RE FORCED TO ANSWER FOR FUNDING, AND EVERYTHING ELSE, AND MAKE SURE YOU’RE KIND OF GOING ALONG WITH THAT, BECAUSE THEN YOU CAN COMPARE ALL YOUR DATA ON A CONTINUUM, AND MAKE SURE IT ALL WORKS TOGETHER, SO IT’S ALL FUN. OOH, AND ANOTHER EXAMPLE, OF BIAS IN A QUESTION, IT DOESN’T NECESSARILY HAVE TO BE COMPLETELY BLATANT LIKE THE POLITICAL ONES, IT COULD BE SIMPLE, LIKE, ARE YOU ONE OF THE UNCULTURED POPULATION WHO PREFERS MILK CHOCOLATE TO DARK? WHAT ABOUT YOU, JOE? ARE YOU AN UNCULTURED PERSON WHO MILK CHOCOLATE AND NOT DARK?>>YEAH, I WAS GOING TO SAY. GEE, NO BIAS THERE, AT ALL.>>NO BIAS AT ALL.>>FOR ME IT’S CHOCOLATE. IT DOESN’T MATTER WHAT KIND IT IS.>>OKAY, YEAH.>>JUST FOR THE RECORD.>>GOOD TO KNOW. OKAY, SO ONE OF THE THINGS THAT I HAVE FOR US HERE IS A QUICK FIND THE FLAW, OR MANY FLAWS, IN THIS QUESTION, WHICH IS, WHERE DO YOU GET INFORMATION ABOUT HOW MILLENIALS ARE RUINING OUR CULTURE AND OUR ECONOMY? TV, NEWSPAPERS, MAGAZINES, ONLINE, FACEBOOK. AND THIS WOULD BE AN EXAMPLE OF A CLOSED-ENDED QUESTION, ONCE AGAIN. I’M JUST– YOU DON’T HAVE TO ENTER THE ANSWERS ANYWHERE. YOU CAN JUST THINK ABOUT IT ON YOUR OWN. KIND OF THINK ABOUT, LIKE, YEAH, SO, YOU KNOW, WHEREVER– WHEREVER YOU THINK WE’RE RUINING– SORRY. I JUST SAID “WE.” THIS IS JUST UPPING THE SOCIAL DESIRABILITY BIAS, SO NOW YOU KNOW THAT I’M A MILLENNIAL, SO MAYBE THAT’S GOING TO CHANGE YOUR ANSWERS A LITTLE BIT, BUT WHAT ARE– WHERE DO YOU LEARN ABOUT THE VARIOUS THINGS MILLENIALS KILL EVERYDAY, WHETHER IT’S ECONOMICALLY OR CULTURALLY. THINGS LIKE THAT. SO… HERE ARE SOME OF THE ANSWERS, AND THIS IS NOT EVEN A COMPLETELY, YOU KNOW, A COMPLETE EXAMPLE OF THE WONDERFUL BIOSPHERE THAT THIS IS LIVING IN. SO WHERE DO YOU GET INFORMATION ABOUT HOW MILLENIALS ARE RUINING– SO HOPEFULLY YOU SEE “MILLENIALS ARE RUINING” AS A BIASED PHRASE. HOPEFULLY, I SAY THAT AS I CRY TO MYSELF AS A MILLENNIAL.>>YEAH, THAT ONE WAS PRETTY CLEAR.>>YEAH, IT’S ALSO A LITTLE BIT OF UNCLEAR WORDING, “WHAT IS RUINING,” ULTIMATELY, WE DON’T KNOW. MAYBE TO SOME PEOPLE IT ISN’T RUINING. MAYBE IT’S SOME PEOPLE ARE DOING IT GREAT. THEN YOU HAVE THE DOUBLE-BARRELED QUESTION HERE, IT’S “CULTURE” AND “ECONOMY.” THEY’RE TWO DIFFERENT THINGS. MAYBE, YOU KNOW, ECONOMY FOR SOME THINGS, LIKE NAPKINS, AREN’T DOING SO GREAT, BUT AVOCADOS, FROM WHAT I HEAR, AVOCADOS AND BREAD ARE DOING GREAT, AVOCADO TOAST, SO IT’S ONCE AGAIN DOUBLE-BARRELED. THEN YOU HAVE THE LIMITED NUMBER OF OPTIONS THAT DO NOT ALLOW PEOPLE TO ACCOUNT FOR EVERYTHING. MAYBE YOU ONLY LEARN ABOUT WHAT MILLENIALS ARE DOING VIA THE RADIO. THERE’S ALSO SOME UNCLEAR OPTIONS AND OVERLAP HERE. A LOT OF PEOPLE GET THEIR TV, THEIR NEWSPAPERS, THEIR MAGAZINES, EVERYTHING IS ONLINE ALREADY. THEN YOU ALSO HAVE ONLINE AND FACEBOOK– FACEBOOK ONLY EXISTS ONLINE, AND WE ALSO USE JARGON HERE. I USED THE ACRONYM FOR IT, OR I GUESS INITIALS FOR FACEBOOK, SO THERE’S A LOT OF THINGS GOING ON HERE, AND I THINK I SAW POP UP, A GOOD WAY TO ASK THE QUESTION, AND IT COULD BE, LIKE YOU SAID, WHERE– HOW DO YOU LEARN ABOUT HOW MILLENIALS ARE CHANGING– ALTER, OR CHANGING THE ECONOMY. I WOULD STILL MAYBE STEER CLEAR OF “AFFECTING.” IT MAY HAVE A LITTLE BIT MORE OF A CAUSE AND AFFECT, OR A SLIGHTLY NEGATIVE BIAS, BUT NOT NEARLY AS MUCH AS “ARE RUINING THE CULTURE.”>>RIGHT, RIGHT, BUT YEAH, THAT’S STILL SHOWING BIAS.>>AND, IF YOU LIKED THIS ACTIVITY, THERE’S IN THE FILES, IN THE BOTTOM RIGHT, THERE’S THE “FIND THE FLAW” WORKSHEET. IT’S ANOTHER LIST. THEY DON’T HAVE ANSWERS, SO YOU JUST GOT TO FEEL IT OUT YOURSELF. IF YOU DO WANT SPECIFIC ANSWERS, YOU CAN ALWAYS EMAIL US AND WE CAN GO OVER THEM WITH YOU, BUT AS YOU’VE POINTED OUT, IT’S KIND OF AN ENDLESS OPPORTUNITY WHERE EVERY SINGLE PERSON READS A QUESTION DIFFERENTLY, WHICH IS, ONCE AGAIN, YOU KNOW, DEATH OF THE AUTHOR. YOU SEND THE SURVEY OUT THERE AND IT’S AT THE WILL OF WHOEVER’S READING IT, ULTIMATELY, TO BE ABLE TO FIGURE OUT WHAT THEY THINK IT MEANS, BUT THERE’S A PDF, AND IT HAS MANY WONDERFUL QUESTIONS LIKE THIS WHERE YOU CAN KIND OF BREAK IT DOWN. SO, AFTER GOING THROUGH ALL OF THOSE DON’TS AND DOS, YOU PROBABLY ARE WONDERING, SHOULD I MAKE A SURVEY? AND THAT’S ESSENTIALLY A DO MAKE A SURVEY SECTION, IS IF YOU KNOW WHAT YOU WANT TO MEASURE. IF IT’S SOMETHING THAT YOU KNOW YOU WILL CHANGE, OR WANT TO CHANGE. SOMEONE ASKED ME THE OTHER DAY IF I COULD HELP THEM MAKE A SURVEY REGARDING SOMETHING, AND AS THEY WERE TALKING ABOUT IT, IT REALLY KIND OF STARTED BECOMING CLEAR THAT THEY WEREN’T GOING TO MAKE ANY CHANGES. THEY WERE JUST KIND OF, YOU KNOW, MAKING A SURVEY TO CHECK THE BOX, AND THAT– IT WASN’T SOMETHING WHERE, ULTIMATELY, I DECIDED THAT I DON’T REALLY THINK I NEED A SURVEY, SO WE’RE INSTEAD GOING TO CHANGE IT INSTEAD OF ASKING ALL THESE OTHER QUESTIONS, WHICH ADDS TO THE SURVEY FATIGUE. JUST ASK THE QUESTIONS THAT THEY’RE, YOU KNOW, LEGALLY REQUIRED TO GET TO CONTINUE FUNDING. THINGS LIKE THAT. BECAUSE THEY– THEIR HANDS ARE TIED AND THEY CAN’T, THEY ACTUALLY CAN’T MAKE ANY CHANGES LEGALLY.>>RIGHT, RIGHT, AND YEAH. DEFINITELY BE AWARE OF THE FACT THAT THERE ARE SURVEYS EVERYWHERE, AND YOU DON’T WANT TO ADD TO THE CACOPHONY UNLESS IT’S WORTHWHILE. YOU DON’T WANT TO ANNOY PEOPLE. YOU WANT TO GET INFORMATION FROM THEM. SO IF IT’S SOMETHING MAYBE THAT YOU HAVE NO INTENTION OF CHANGING, EVENTUALLY, YOU’RE GOING TO PROBABLY– YOU’RE GOING TO WANT TO ASK SOMETHING DOWN THE ROAD OF THESE FOLKS, SO HOLD OFF UNTIL YOU HAVE SOMETHING THAT YOU’RE ACTUALLY LOOKING TO CHANGE, AND TAKE THE TIME TO DESIGN A REALLY– A REALLY WELL- DESIGNED SURVEY, DEFINITELY.>>AND ALSO MAKE SURE YOU, WHEN YOU GO INTO THIS, THAT YOU HAVE A PLAN FOR HOW YOU WILL DISTRIBUTE THIS SURVEY. YOU CAN’T JUST SAY, “HERE’S A SURVEY.” IT’S THERE, IT’S DONE. ARE YOU GOING TO– WHAT ARE THE CHANNELS THAT YOU’RE GOING TO SEND IT THROUGH. IS IT VIA EMAIL, IS IT GOING TO BE ON YOUR WEBSITE, IS IT GOING TO BE BOTH? WILL YOU ALSO HAVE PAPER SURVEYS AVAILABLE IF YOU’RE– MAYBE YOU FINISHED A PRESENTATION AND YOU WANT PEOPLE TO FILL OUT THE PAPER SURVEYS, WILL YOU HAVE IT AVAILABLE ALSO VIA A LINK ON THE SCREEN FOR PEOPLE WHO AREN’T ABLE TO COMPLETE A PAPER SURVEY OR WOULD NEED TO HAVE THE PAPER SURVEY READ TO THEM. YOU WANT TO THINK ABOUT ACCESSIBILITY WHILE YOU’RE DOING THIS. DO MAKE A SURVEY IF YOU’RE TRYING TO REACH A LARGE GROUP OF PEOPLE AND YOU WANT TO GET GENERALLY THE SAME KIND OF QUESTIONS FROM EACH PERSON. YOU CAN USE LOGIC TO KIND OF CHANGE AND SWITCH WHAT QUESTIONS AND ANSWERS THEY SEE, BUT IF IT’S SOMETHING WHERE YOU NEED TO GET REALLY IN DEPTH ON REALLY SPECIFIC TOPICS THAT ARE DIFFERENT PER PERSON, A SURVEY’S PROBABLY NOT THE BEST WAY TO GO FOR THAT, AND THEN DO MAKE A SURVEY IF YOU’RE OKAY WITH LIMITING THE NUMBER OF OPEN ENDED QUESTIONS. ONCE AGAIN, IF IT IS NOTHING BUT OPEN ENDED QUESTIONS THE ENTIRE THING, YOU MIGHT BE BETTER OFF WITH AN INTERVIEW. THERE ARE, OBVIOUSLY IF YOU WANT TO GET ALL THOSE OPEN ENDED QUESTIONS FROM A LARGE GROUP OF PEOPLE, A SURVEY IS PROBABLY STILL A GOOD METHOD TO DO IT, BUT YOU ALSO HAVE TO CONSIDER HOW MUCH TIME WILL IT TAKE THEM TO COMPLETE THAT SURVEY. WILL YOU GET A LOT OF PEOPLE DROPPING OFF MIDWAY THROUGH THE SURVEY. WILL YOU GET ANSWERS FROM EVERY PERSON, THINGS LIKE THAT. SO I HAVE– TWO SLIDES HERE OF QUICK TIPS, ONE FOR ALL SURVEYS, AND THEN ONE FOR ONLINE SURVEYS, AND THIS FIRST ONE IS KEEP YOUR SCALES UNIFORM. PLEASE, PLEASE, PLEASE, PLEASE, PLEASE, PLEASE. ESPECIALLY IF YOU’RE HAVING SOMEONE ELSE GO OVER YOUR SURVEY DATA AND IT’S NOT YOU, IF YOU OFFER FIVE OPTIONS IN ONE QUESTION, DO IT IN THE OTHERS AS WELL. I HAVE GONE THROUGH SURVEYS BEFORE FOR PEOPLE WHERE SOME QUESTIONS THEY OFFER STRONGLY AGREE TO STRONGLY DISAGREE, AND THEN IN ANOTHER ONE THEY ANSWER– THEY OFFER ONLY FOUR OPTIONS. SO YOU’RE LOOKING AT DIFFERENT– YOU CAN’T COMPARE THE DATA APPLES TO APPLES. IT THEN BECOMES APPLES TO ORANGES, AND YOU HAVE TO EXPLAIN EVERYTHING AND IT BECOMES A LITTLE MORE– A LITTLE MORE TAXING TO GET THROUGH IT ALL FOR EVERYONE TO UNDERSTAND. WHEN YOU’RE TRYING TO SAY, “THIS GOT THREE OUT “OF FOUR STARS,” AND SOMEONE ELSE SAYS, “THIS GOT FOUR OUT “OF FIVE STARS,” IT JUST SEEMS DIFFERENT AND IT GETS CONFUSING. I WOULD ALSO SAY DON’T FLIP FLOP ON YOUR SCALES EITHER. IF YOU’RE ASKING STRONGLY AGREE TO STRONGLY DISAGREE IN ONE DON’T SWITCH IT IN THE NEXT. IT IS SOMETHING WHERE MAYBE YOU WANT PEOPLE TO STOP IF YOU’RE ASKING IT AND IT STARTS STRONGLY AGREE, AND PEOPLE ARE INCLINED TO JUST EXTRA BE NICE TO YOU, IT’S SOCIAL DESIRABILITY BIAS. THINGS LIKE THAT. MAYBE SWITCH IT IN THE ENTIRE SURVEY SO IT STARTS STRONGLY DISAGREE FIRST SO PEOPLE HAVE TO STOP, REALIZE WHAT’S HAPPENING, AND THEN REALLY THINK ABOUT WHAT THEY’RE GOING TO DO. BUT ONCE AGAIN, KEEP IT THE SAME THROUGHOUT THE ENTIRE SURVEY. AND EACH SURVEY SHOULD ALSO FOLLOW A GENERAL OUTLINE. IT’S KIND OF LIKE A BASIC ESSAY WHERE YOU HAVE THE INTRODUCTION, THE BODY, AND THE CLOSING. BEFORE THE CLOSING, THAT’S WHERE YOU SLIP IN YOUR DEMOGRAPHIC QUESTIONS. THEY’RE THE EASIEST, HOPEFULLY, FOR PEOPLE TO ANSWER. GO THROUGH ALL OF THAT, AND IT SHOULD HOPEFULLY GO REALLY SMOOTHLY, AND BE– ALWAYS. ALWAYS, ALWAYS, ALWAYS, FOR THE DEMOGRAPHIC QUESTIONS, ASK ONLY WHAT YOU NEED. IT’S… IT’S JUST EASIER ON EVERYONE’S– FOR EVERYONE GETS GOING OVER THE SURVEY. IT’S EASIER FOR THE PEOPLE THEY KNOW THAT THEY’RE NOT GIVING UP SO MANY– SO MUCH PRIVACY INFORMATION. IF YOU’RE ASKING AGE, I ALMOST ALWAYS– DO BIRTH YEAR SO THERE’S LESS, YOU KNOW, AMBIGUITY IN WHAT’S GOING ON. ALWAYS, I TEND TO MAKE AGE OPTIONAL BECAUSE PEOPLE DON’T LIKE SHARING THEIR AGE SOMETIMES. WHO WOULD HAVE THOUGHT? AND WHEN YOU DO IT, OR WHEN YOU DO ANY DEMOGRAPHIC QUESTIONS, ALWAYS INCLUDE A NOTE EXPLAINING WHY YOU NEED IT. IT MAKES PEOPLE FEEL A LITTLE BETTER, AND IT HELPS THEM MAYBE, YOU KNOW– MAYBE THEY WOULDN’T GIVE THEIR AGE, BUT IF THEY’RE DOING A SURVEY THAT’S SPECIFICALLY FOR THESE THINGS, THEY’D BE MORE INCLINED TO DO IT. AND THEN THE LAST ONE IS TINY INCENTIVES ARE BETTER THAN A CHANCE AT A BIG INCENTIVE, SO WE’VE ALL SEEN, YOU KNOW, “ENTER THIS SURVEY, AND YOU’LL “BE, YOU KNOW, ENTERED INTO “A RAFFLE FOR A CHANCE TO WIN “$100,” OR SOMETHING LIKE THAT. YOU’RE MORE LIKELY TO GET PEOPLE TO COMPLETE THE SURVEY IF YOU OFFER THEM A TINY PIECE OF CHOCOLATE, MILK OR DARK, JOE DOESN’T CARE, OR SOMETHING LIKE THAT. A TINY PENCIL, PEN, ANYTHING LIKE THAT, PEOPLE ARE MORE LIKELY TO COMPLETE IT THAN IF THEY, YOU KNOW, GET ENTERED INTO A RAFFLE. OKAY. YOU LOOK LIKE YOU WANTED TO SAY SOMETHING.>>WELL, I WAS JUST THINKING, YEAH, PHYSICAL THINGS, BUT, YOU KNOW, IF IT’S AN ONLINE SURVEY, YOU’RE NOT GOING TO GET THEM PHYSICAL SOMETHING OR OTHER. YOU MIGHT HAVE A COUPON CODE FOR A SERVICE OR WHATEVER, BUT YOU GOT THE POINT THAT YOU WERE GETTING TO.>>I’M GLAD.>>WHAT YOU NEED TO SEE.>>OH, FINE FORGIVENESS IS A GREAT IDEA, YOU ARE RIGHT. SO IT’S JUST– IT’S A LITTLE SOMETHING, AND IT-IT’S REALLY HELPFUL, ‘CAUSE THEY KNOW THEY’RE GOING TO GET IT. IT’S NOT SOMETHING A WHAT-IF. IT’S A VERY TANGIBLE THING FOR THEM, AND THEN QUICK TIPS FOR ONLINE SURVEYS. IF YOU REMEMBER THE OTHER QUESTION I WAS TALKING ABOUT WHERE PEOPLE ENTERED SEVEN INSTEAD OF SELECTING ZERO TO NINE, YOU WON’T BELIEVE THE NUMBER OF TIMES PEOPLE TYPED SEVEN IN SO MANY DIFFERENT WAYS. SO WHAT YOU CAN DO IS IF IT IS SOMETHING WHERE– LIKE A PHONE NUMBER, OR SOMETHING WHERE YOU KNOW IT’S GOING TO BE IN A CERTAIN FORMAT, YOU CAN GO INTO MOST SURVEY TOOLS AND SELECT THE EXACT TYPE YOU WANT IT TO BE, SO, YOU KNOW, THEY TYPE IN THE WORD ONE, IT WON’T WORK, AND IT’LL SAY YOU NEED TO GIVE THE NUMBER. OR IF THEY TRY TO ENTER IT WITH DECIMALS, IT’LL SAY, “SORRY, YOU KNOW, YOU CAN ONLY USE INTEGERS OR WHOLE NUMBERS,” THINGS LIKE THAT. ONCE AGAIN, USE “OTHER” CAREFULLY OR BE PREPARED FOR MORE TIME CLEANING YOUR DATA. AT THE– AT THE END OF THE DAY, WITH THAT QUESTION, THE NUMBER OF PEOPLE WHO SELECTED OTHER AND ACTUALLY DID USE IT FOR THE INTENDED PURPOSE OF SOMEWHERE WHERE THEY DON’T QUITE FIT INTO THE OTHER THINGS IS VERY SMALL. IT WAS TWO PEOPLE OUT OF OVER 1,000 RESPONSES, SO IT, AT THE END OF THE DAY, IT WAS ONE OF THOSE THINGS WHERE WE KIND OF REALIZED IT WASN’T WORTH THE EFFORT, SO IF IT’S SOMETHING WHERE, ARE YOU REALLY GOING TO CONSIDER THOSE OTHERS? IS THAT REALLY SOMETHING THAT’S GOING TO HAVE A BIG IMPACT FOR YOU, OR IS IT SOMETHING WHERE YOU MIGHT AS WELL– IT’S OKAY IF PEOPLE SKIP IT INSTEAD? CONSIDER THAT, AND WEIGH THOSE OPTIONS. OKAY, THIS NEXT ONE IS SOMETHING I’M NOT ENTIRELY SURE OF YET, BUT THEY SPOKE HIGHLY OF IT AT THE RESEARCH INSTITUTE FOR PUBLIC LIBRARIES, AND THEY SAID THAT RATHER THAN A CHECK ALL THAT APPLY QUESTION, YOU WILL GET MORE RELIABLE DATA WITH THE MATRIX OF YES AND NO OPTIONS, SO RATHER THAN, YOU KNOW, WHAT FRUITS DO YOU ENJOY– APPLE, ORANGE, PEAR– IF YOU SAY, “DO YOU ENJOY APPLES?” YES, NO. “DO YOU ENJOY PEARS?” YES, NO. YOU’RE MORE LIKELY TO GET PEOPLE TO GO THROUGH AND DO IT SYSTEMATICALLY AND THINK ABOUT IT RATHER THAN JUST CHECKING AND MAYBE MISSING ONE. I WILL SAY THAT ON THE, YOU KNOW, DATA ANALYSIS SIDE, IT DOES COME THROUGH A LITTLE CLEANER IN A SPREADSHEET IF YOU’RE GOING TO BE ENDING UP DOING GRAPHS AND THINGS LIKE THAT FOR US. YOU DON’T GET ONE OF THOSE THINGS WHERE IT SAYS, “APPLE COMMA, PEAR COMMA,” AND EACH ONE’S DIFFERENT, AND YOU HAVE TO THEN BREAK THEM OUT INTO DIFFERENT THINGS, AND THEN SEND SURVEYS OUT. TUESDAY MORNINGS IS SUPPOSED TO BE THE BEST TIME. PEOPLE ARE A LITTLE BIT OVER THE MONDAY FUNK. THEY HAVEN’T QUITE GOT INTO THE SWING OF THE WEEK YET. THEY’RE STILL A LITTLE, YOU KNOW, A LITTLE UPSET THAT THEY’RE IN THE FIRST HALF OF THE WEEK, BUT THEY’RE CHECKING THEIR EMAIL. THEY’RE GOING THROUGH ALL THESE THINGS, AND THEN YOU SEND THE REMINDER ON THURSDAY. WITH THIS IN MIND, THAT’S WHY WE SENT THE SURVEY OUT ON A FRIDAY MORNING FOR THIS PRESENTATION, AND THAT’S PROBABLY WHY WE DON’T GET GREAT RESPONSES FOR OUR SURVEYS, JOE. ‘CAUSE WE SEND IT AT– HONESTLY, THE ONLY TIME WORSE THAN FRIDAY MORNING WOULD BE SATURDAYS, FRIDAY EVENINGS– TIMES WHERE YOU PROBABLY WOULDN’T BE CHECKING YOUR WORK EMAIL.>>SUNDAY AT 9:00 AM.>>YEAH, OH, I ALWAYS TAKE THOSE SURVEYS, JOE. BUT IT’S JUST– IT’S BEST TO DO IT TUESDAY MORNINGS. IT’S WHEN PEOPLE PROBABLY WANT TO KILL A LITTLE TIME BUT STILL FEEL LIKE THEY’RE DOING SOMETHING WORTHWHILE. AND THEN REMEMBER, REMEMBER REMEMBER, ALWAYS ACT WITH INTENTIONALITY. WHAT DO YOU WANT TO LEARN? THINK ABOUT THAT WITH EVERY SINGLE QUESTION YOU ASK, AND THEN WHO DO YOU WANT TO LEARN ABOUT, SO, YOU KNOW, IF YOU WANT TO LEARN ABOUT STORYTIMES, BUT YOU R– AND WHAT ARE THE GOOD TIMES FOR STORYTIMES, BUT YOU WANT TO HEAR ABOUT IT NOT FROM THE PEOPLE WHO GO ALL THE TIME, BUT FROM THE PEOPLE WHO HAVE NEVER BEEN TO A STORYTIME, BUT YOU THINK WOULD BE A GREAT FIT, HOW ARE YOU GOING TO REACH THEM, AND WHAT ARE THE QUESTIONS YOU’RE GOING TO ASK, BECAUSE THEY’RE DIFFERENT. POWER USERS ARE DIFFERENT FROM THE NON-USERS, AND THINGS LIKE THAT, SO YOU ALWAYS HAVE TO THINK ABOUT THE INTENTIONALITY BEHIND EVERYTHING WHEN YOU DO IT. SO WHAT’S NEXT? OUR NEXT ONE IS GOING TO BE EASY, BREEZY, USABILITY STUDIES. MAYBE SHE’S BORN WITH IT, MAYBE IT’S ITERATIVE TESTING. WHO KNOWS. BUT, IT’S– ONCE AGAIN, WE’RE KEEPING IT LIGHT, AIRY, QUICK, THE BASICS OF ALL OF THESE THINGS. AND ALSO, HEY, REMEMBER THAT SURVEY THAT WE’RE SENDING OUT AT A REALLY INOPPORTUNE TIME, AKA RIGHT NOW, PLEASE OPEN THIS LINK. IT DOESN’T MATTER IF YOU’RE WATCHING THE RECORDING OR NOT, IT’LL BE A GREAT HELP TO US, AND IT WILL ALLOW US TO CONTINUE TO GET FUNDING, WHICH IS REALLY IMPORTANT TO US, AND WE LOVE IT, BUT THAT ESSENTIALLY IS THE WRAP UP FOR SURVEYS, SO IF ANYONE HAS ANY QUESTIONS, WE WOULD BE HAPPY TO ANSWER THEM. IT SAYS YOU ALREADY TOOK THE SURVEY. OH, NO, WHAT DID I DO? OKAY, I WILL GO THROUGH AND OPEN THAT. I’M NOT SURE WHAT’S GOING ON, BUT– DO YOU HAVE AN IDEA?>>IT MIGHT BE A SETTING– BECAUSE OF THE SIMILAR URL THAT IT– SURVEY MONKEY IS READING IT, SO WE CAN HAVE THAT FIXED.>>YEAH, WE’LL HAVE THAT FIXED. I’LL SEND IT– WE’LL SEND IT OUT THIS AFTERNOON ALSO, WHEN WE SEND OUT THE RECORDING OF THIS. I’LL ALSO SAY THAT IF YOU EVER NEED ANYONE TO PROOFREAD A SURVEY, I AM MORE THAN HAPPY TO GO OVER IT, LOOK AT IT, THINGS LIKE THAT. ANOTHER GOOD PLACE TO GET SURVEYS THAT ARE LIKE ALREADY TESTED, BUILT IN TEMPLATES, IS PROJECT OUTCOME. WE HAVE IT FOR ALL THE PUBLIC LIBRARIES IN THE STATE OF MICHIGAN. THEY HAVE NICE, BASIC QUESTIONS THAT IF YOU WANT TO GET A NICE– A GOOD BASELINE FOR PROGRAMS, SERVICES, THINGS LIKE THAT, THEY HAVE THEM IN DIFFERENT CATEGORIES, AND IT’S REALLY USEFUL TO GET THEM THAT WAY. BUT IF ANYONE HAS ANY QUESTIONS RIGHT NOW, FEEL FREE TO TYPE THEM IN THE CHAT BOX, AND WE WILL MONITOR THIS. YES, GOOGLE FORMS ARE ALSO EASY SURVEYS, AND THEY’RE REALLY GOOD FOR SHARING DATA EASILY BETWEEN PEOPLE, ESPECIALLY IF YOU’RE NOT, YOU KNOW– SURVEY MONKEY, YOU HAVE TO HAVE THE ACCOUNT LOG IN, AND THEN YOU HAVE TO EXPORT IT TO A SPREADSHEET, BUT YOU CAN GET THE NICE GOOGLE SHEETS, YOU KNOW, LINK THAT CAN GO OUT TO EVERYONE AND SHARE IT QUITE EASILY. IT’S SOMETHING THAT I THINK WE WOULD USE IN THE STATE OF MICHIGAN IF WE WERE LEGALLY ALLOWED TO DO SO.>>YEAH, I LOVE GOOGLE SHEETS. THAT-THAT’S MY TOOL THAT I CAN’T USE HERE, BUT I WOULD DEFINITELY USE THAT, YEAH, ABSOLUTELY.>>BUT AS WE WERE SAYING, THAT’S ONE WHERE YOU GET THE CREATIVITY OF WRITING YOUR OWN QUESTIONS AND MAKING SURE THAT THEY DON’T HAVE BIAS, THAT THEY USE EVERYDAY LANGUAGE AND THINGS LIKE THAT. PROJECT OUTCOME, THE QUESTIONS ARE PRE-WRITTEN FOR YOU. SO, YOU KNOW, GIVE OR TAKE, MAYBE IT WON’T BE AS SPECIFIC FOR YOUR NEEDS, BUT IT’S SOMETHING TO CONSIDER.>>AND YOU DO HAVE THE ABILITY TO ADD TWO QUESTIONS?>>THREE, THREE.>>THREE QUESTIONS.>>THEY EITHER FIT INTO A– LIKE AN ALREADY SET FORM, OR IT’S OPEN-ENDED RESPONSE, SO IF YOU WANTED TO ASK A STRONGLY AGREE TO STRONGLY DISAGREE QUESTION, AND IT WASN’T ONE OF THEIR BUILT-IN–>>RIGHT, YOU COULDN’T DO THAT.>>YOU COULDN’T DO IT. SO THERE ARE PROS AND CONS, BUT IT’S A PRETTY GREAT TOOL, NONETHELESS.>>RIGHT, AND YOU CAN COMPARE RESULTS ACROSS MULTIPLE THINGS. THAT’S WHY THEY DO THAT. SO…>>YEAH. ANY OTHER QUESTIONS? EXCELLENT. YAY!>>SO WE ARE GOING TO MAKE THIS AVAILABLE TO EVERYONE WHO REGISTERED, SO YOU’LL BE GETTING THAT LINK SHORTLY. AND THEN FOR THE FOLKS THAT DIDN’T REGISTER, THE WAY WE DO THINGS OVER HERE FOR ACCESSIBILITY IS WE’LL DOWNLOAD THIS AS A VIDEO, AND THEN IT NEEDS TO GO OVER AND GET ITS SUBTITLING, AND THEN IT WILL BE AVAILABLE ON OUR YOUTUBE PAGE, SO RIGHT NOW THERE’S FIVE OR SIX OF THESE ON OUR YOUTUBE PAGE, AND WE CAN SEND YOU OUT THE LINK FOR THAT IF YOU’RE INTERESTED IN THE OTHER WEBINARS AND THE SAVE THE DATA SERIES. WE CAN GET THOSE TO YOU. THAT’S NOT A PROBLEM. AND THANKS FOR JOINING US TODAY, FOLKS.>>YES.>>WE’LL SEE YOU ON SEPTEMBER 14.>>HAVE A NICE WEEKEND.