A social experiment. What is the worst that can happen?What is the best career choice for a social psychology graduate?What is the perception of foreign Universities (Non UK) in the US for prospective academic positions (Postdoc/Tenure)?When applying for postdoc funding, what are the consequences of backing out if I can get another position where funding is already secured?What are paths that physics majors/PhDs can follow?If a postdoc is interested to apply for a future professorship in his/her current institution. What should she/he do in the postdoc research period?What could my postdoctoral advisor do, now that he knows that I started looking for positions in industry?What employment can someone obtain if they were not given the PhD after studying and publishing?What is the best advice to obtain a post doc given my age and situation?Gender transition as a starting faculty member: a terrible idea?Can I tell the PI who has offered me a postdoc job that I have not decided yet waiting for other results

Can disgust be a key component of horror?

Fear of getting stuck on one programming language / technology that is not used in my country

Extract more than nine arguments that occur periodically in a sentence to use in macros in order to typset

Redundant comparison & "if" before assignment

Is aluminum electrical wire used on aircraft?

How to explain what's wrong with this application of the chain rule?

Does Doodling or Improvising on the Piano Have Any Benefits?

Does the UK parliament need to pass secondary legislation to accept the Article 50 extension

Calculate sum of polynomial roots

What are the advantages of simplicial model categories over non-simplicial ones?

What if a revenant (monster) gains fire resistance?

Why should universal income be universal?

Can a College of Swords bard use a Blade Flourish option on an opportunity attack provoked by their own Dissonant Whispers spell?

Is there an injective, monotonically increasing, strictly concave function from the reals, to the reals?

Why did the EU agree to delay the Brexit deadline?

Unexpected behavior of the procedure `Area` on the object 'Polygon'

Does an advisor owe his/her student anything? Will an advisor keep a PhD student only out of pity?

Limits and Infinite Integration by Parts

It grows, but water kills it

What should you do if you miss a job interview (deliberately)?

Open a doc from terminal, but not by its name

Is this toilet slogan correct usage of the English language?

How does a computer interpret real numbers?

Why does a simple loop result in ASYNC_NETWORK_IO waits?



A social experiment. What is the worst that can happen?


What is the best career choice for a social psychology graduate?What is the perception of foreign Universities (Non UK) in the US for prospective academic positions (Postdoc/Tenure)?When applying for postdoc funding, what are the consequences of backing out if I can get another position where funding is already secured?What are paths that physics majors/PhDs can follow?If a postdoc is interested to apply for a future professorship in his/her current institution. What should she/he do in the postdoc research period?What could my postdoctoral advisor do, now that he knows that I started looking for positions in industry?What employment can someone obtain if they were not given the PhD after studying and publishing?What is the best advice to obtain a post doc given my age and situation?Gender transition as a starting faculty member: a terrible idea?Can I tell the PI who has offered me a postdoc job that I have not decided yet waiting for other results













2















I am a postdoc and I have been applying for jobs in both industry and academia. My h-index is good enough for junior faculty (~7).



My buddy (same age and career stage) is wondering why I am getting interviews but she isn't. FYI She is publishing way more than I am, although hers is in an area that appears female dominated. I have had a handful of final stage interviews (faculty/scientist) for academia but none in industry so far. (I have academic and industry oriented CVs and send them out accordingly)



I suspect I have the qualifications and skills but I am being interviewed as the "token diverse female" in a white male dominated area of science. The whole process, along with prior job hunt experiences, has led me to suspect that my gender and race (yes asian female here) may be hindering my earning potential.



I am thinking of reapplying to these same jobs I got rejected for (especially the rejections without interview) just to see if how far along I would get if I applied as a white male. Only for industry jobs because those CVs don't make it to the chief scientist's table. Maybe make a documentary or blog about this if there are significant findings. Now put your imaginations to the test: what is the worst that can happen?










share|improve this question



















  • 2





    what is the worst that can happen? Fake you gets job. Real you can't actually take it due to fraud. You or someone else misses out on job.

    – Thomas
    2 hours ago











  • So you would be applying to these positions under a fake name? Or will you just be filling in the data that is collected for statistical purposes (and US hiring committees never see) as "white, male"?

    – Morgan Rodgers
    2 hours ago











  • A "pen name", to put it nicely.

    – FrostedCentral
    2 hours ago






  • 6





    This is known as an audit study. There are accepted ethics for studies of this type. If you hope to publish, IRB would need to be completed. There is considerable literature on this question.

    – Dawn
    2 hours ago






  • 2





    @Dawn, I'd love to see your comment expanded to an answer.

    – Buffy
    2 hours ago















2















I am a postdoc and I have been applying for jobs in both industry and academia. My h-index is good enough for junior faculty (~7).



My buddy (same age and career stage) is wondering why I am getting interviews but she isn't. FYI She is publishing way more than I am, although hers is in an area that appears female dominated. I have had a handful of final stage interviews (faculty/scientist) for academia but none in industry so far. (I have academic and industry oriented CVs and send them out accordingly)



I suspect I have the qualifications and skills but I am being interviewed as the "token diverse female" in a white male dominated area of science. The whole process, along with prior job hunt experiences, has led me to suspect that my gender and race (yes asian female here) may be hindering my earning potential.



I am thinking of reapplying to these same jobs I got rejected for (especially the rejections without interview) just to see if how far along I would get if I applied as a white male. Only for industry jobs because those CVs don't make it to the chief scientist's table. Maybe make a documentary or blog about this if there are significant findings. Now put your imaginations to the test: what is the worst that can happen?










share|improve this question



















  • 2





    what is the worst that can happen? Fake you gets job. Real you can't actually take it due to fraud. You or someone else misses out on job.

    – Thomas
    2 hours ago











  • So you would be applying to these positions under a fake name? Or will you just be filling in the data that is collected for statistical purposes (and US hiring committees never see) as "white, male"?

    – Morgan Rodgers
    2 hours ago











  • A "pen name", to put it nicely.

    – FrostedCentral
    2 hours ago






  • 6





    This is known as an audit study. There are accepted ethics for studies of this type. If you hope to publish, IRB would need to be completed. There is considerable literature on this question.

    – Dawn
    2 hours ago






  • 2





    @Dawn, I'd love to see your comment expanded to an answer.

    – Buffy
    2 hours ago













2












2








2








I am a postdoc and I have been applying for jobs in both industry and academia. My h-index is good enough for junior faculty (~7).



My buddy (same age and career stage) is wondering why I am getting interviews but she isn't. FYI She is publishing way more than I am, although hers is in an area that appears female dominated. I have had a handful of final stage interviews (faculty/scientist) for academia but none in industry so far. (I have academic and industry oriented CVs and send them out accordingly)



I suspect I have the qualifications and skills but I am being interviewed as the "token diverse female" in a white male dominated area of science. The whole process, along with prior job hunt experiences, has led me to suspect that my gender and race (yes asian female here) may be hindering my earning potential.



I am thinking of reapplying to these same jobs I got rejected for (especially the rejections without interview) just to see if how far along I would get if I applied as a white male. Only for industry jobs because those CVs don't make it to the chief scientist's table. Maybe make a documentary or blog about this if there are significant findings. Now put your imaginations to the test: what is the worst that can happen?










share|improve this question
















I am a postdoc and I have been applying for jobs in both industry and academia. My h-index is good enough for junior faculty (~7).



My buddy (same age and career stage) is wondering why I am getting interviews but she isn't. FYI She is publishing way more than I am, although hers is in an area that appears female dominated. I have had a handful of final stage interviews (faculty/scientist) for academia but none in industry so far. (I have academic and industry oriented CVs and send them out accordingly)



I suspect I have the qualifications and skills but I am being interviewed as the "token diverse female" in a white male dominated area of science. The whole process, along with prior job hunt experiences, has led me to suspect that my gender and race (yes asian female here) may be hindering my earning potential.



I am thinking of reapplying to these same jobs I got rejected for (especially the rejections without interview) just to see if how far along I would get if I applied as a white male. Only for industry jobs because those CVs don't make it to the chief scientist's table. Maybe make a documentary or blog about this if there are significant findings. Now put your imaginations to the test: what is the worst that can happen?







postdocs job-search job






share|improve this question















share|improve this question













share|improve this question




share|improve this question








edited 2 hours ago







FrostedCentral

















asked 2 hours ago









FrostedCentralFrostedCentral

174126




174126







  • 2





    what is the worst that can happen? Fake you gets job. Real you can't actually take it due to fraud. You or someone else misses out on job.

    – Thomas
    2 hours ago











  • So you would be applying to these positions under a fake name? Or will you just be filling in the data that is collected for statistical purposes (and US hiring committees never see) as "white, male"?

    – Morgan Rodgers
    2 hours ago











  • A "pen name", to put it nicely.

    – FrostedCentral
    2 hours ago






  • 6





    This is known as an audit study. There are accepted ethics for studies of this type. If you hope to publish, IRB would need to be completed. There is considerable literature on this question.

    – Dawn
    2 hours ago






  • 2





    @Dawn, I'd love to see your comment expanded to an answer.

    – Buffy
    2 hours ago












  • 2





    what is the worst that can happen? Fake you gets job. Real you can't actually take it due to fraud. You or someone else misses out on job.

    – Thomas
    2 hours ago











  • So you would be applying to these positions under a fake name? Or will you just be filling in the data that is collected for statistical purposes (and US hiring committees never see) as "white, male"?

    – Morgan Rodgers
    2 hours ago











  • A "pen name", to put it nicely.

    – FrostedCentral
    2 hours ago






  • 6





    This is known as an audit study. There are accepted ethics for studies of this type. If you hope to publish, IRB would need to be completed. There is considerable literature on this question.

    – Dawn
    2 hours ago






  • 2





    @Dawn, I'd love to see your comment expanded to an answer.

    – Buffy
    2 hours ago







2




2





what is the worst that can happen? Fake you gets job. Real you can't actually take it due to fraud. You or someone else misses out on job.

– Thomas
2 hours ago





what is the worst that can happen? Fake you gets job. Real you can't actually take it due to fraud. You or someone else misses out on job.

– Thomas
2 hours ago













So you would be applying to these positions under a fake name? Or will you just be filling in the data that is collected for statistical purposes (and US hiring committees never see) as "white, male"?

– Morgan Rodgers
2 hours ago





So you would be applying to these positions under a fake name? Or will you just be filling in the data that is collected for statistical purposes (and US hiring committees never see) as "white, male"?

– Morgan Rodgers
2 hours ago













A "pen name", to put it nicely.

– FrostedCentral
2 hours ago





A "pen name", to put it nicely.

– FrostedCentral
2 hours ago




6




6





This is known as an audit study. There are accepted ethics for studies of this type. If you hope to publish, IRB would need to be completed. There is considerable literature on this question.

– Dawn
2 hours ago





This is known as an audit study. There are accepted ethics for studies of this type. If you hope to publish, IRB would need to be completed. There is considerable literature on this question.

– Dawn
2 hours ago




2




2





@Dawn, I'd love to see your comment expanded to an answer.

– Buffy
2 hours ago





@Dawn, I'd love to see your comment expanded to an answer.

– Buffy
2 hours ago










1 Answer
1






active

oldest

votes


















5














I like to think I have a pretty vivid imagination, so the worst thing I can reasonably imagine happening is that you would be seen as trying to perform an experiment with human participants without proper controls, questionable experimental design, possibly a lack of appropriately rigorous analysis (if this isn't your specialty), and lack of ethical review and oversight. From an ethics perspective, you propose to use deception on uninformed participants while possibly obtaining personally identifiable information on them which could lead to them facing serious social consequences if they were identified. With the mob mentality of the viral internet as it is, the consequences could be pretty darn severe - up to loss of job, death threats, actual violence, and more. Sensitive topics require sensitive handling, which is what any functioning IRB and responsible researcher would insist on.



In reporting on the results, even if informally on a blog, you could be seen as offering a pseudo-scientific view (or worse) on a controversial and important topic. If your experiment was performed poorly or your analysis done improperly, you could lend weight to an incorrect view - either providing what could be cited as evidence that discrimination does not exist where it does (thus making it harder for people discriminated against to make changes or be taken seriously), or supporting the view that discrimination does exist where it doesn't (leading to negative consequences for people who are doing nothing wrong and deflecting attention away from more pressing, extant issues). Bad science, even done with good intention, can easily make the world worse.



If some random blogger or journalist did this, most of us can gratingly dismiss it as "they don't know any better", or just the world of click-bait, etc. But if you were a qualified scientist who should know better, people might not be so willing to dismiss such activity just because it wasn't intended to be scientific and it wasn't intended for publication. Most people won't even know the difference in what is and isn't intended to be scientific when done by a scientist, and many that do know the difference might not consider it an excuse.



As Dawn pointed out in a comment, one version of this is called an audit study, and there is a pretty large body of literature that tries to do basically what you are suggesting in a systematic way. I cannot even try to count how many studies of this sort are published, but I'd be surprised if it wasn't already in the thousands, looking at everything from gender to race to the impact of varying lengths of time gaps on a resume.



Finally, the nature of this sort of field study is that even with everything going your way they are hard to do correctly. No simple analysis method works even if you did everything right and collected all the data appropriately. There is too much randomness, too much heterogeneity, too much structure, to allow any simple bit of statistics to give the correct interpretation. In short, unless this is your specialty, it would be trivially easy to get everything else right and still come to exactly the wrong conclusion.



For those who are not familiar with this kind of statistics, a classic example of how a simple analysis can go wrong is Sex Bias in Graduate Admissions: Data from Berkeley. In a simple aggregate analysis, it looked quite clearly that women were being admitted at lower rates than men, and thus bias was quite obvious to the point that the deans of the school were concerned this could be the basis for a lawsuit. It turned out it was a nice example of Simpson's Paradox, as it turned out the cause for the difference was that women were more likely to apply to departments that were crowded and competitive and thus harder to get into for everyone, while men were more likely to apply to departments that were less competitive.



If a similar condition existed in the employment sector, where you were applying to jobs in industry that turned out to vary in their selectivity in a way that you were not considering, this would mess up your analysis, and you cannot easily collect more information that would allow you to fix it. After all, I'm sure you weren't inclined to use random selection in your own employment search!



So, in summation, the worst that I could imagine happening is: you end up doing bad science that would reflect badly on you and would not be easily excused just because it wasn't intended for publication; you come to the wrong conclusions and in a way which could hurt innocent people; you casually report information that could be used in dangerous and damaging way; you end up being identified as the person responsible and it goes viral, so now the most famous thing you'll ever be known for was this thing you didn't intend as a serious study (and which could have gone horribly wrong); and, as a bonus, you could just end up wasting your time and the time of others for no benefit.



And since its the worst thing that can happen, I suppose you could also end up with a headache. Things can always be worse by adding a headache.






share|improve this answer























  • Here, have two aspirin.

    – FrostedCentral
    14 mins ago










Your Answer








StackExchange.ready(function()
var channelOptions =
tags: "".split(" "),
id: "415"
;
initTagRenderer("".split(" "), "".split(" "), channelOptions);

StackExchange.using("externalEditor", function()
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled)
StackExchange.using("snippets", function()
createEditor();
);

else
createEditor();

);

function createEditor()
StackExchange.prepareEditor(
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader:
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
,
noCode: true, onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
);



);













draft saved

draft discarded


















StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2facademia.stackexchange.com%2fquestions%2f126930%2fa-social-experiment-what-is-the-worst-that-can-happen%23new-answer', 'question_page');

);

Post as a guest















Required, but never shown

























1 Answer
1






active

oldest

votes








1 Answer
1






active

oldest

votes









active

oldest

votes






active

oldest

votes









5














I like to think I have a pretty vivid imagination, so the worst thing I can reasonably imagine happening is that you would be seen as trying to perform an experiment with human participants without proper controls, questionable experimental design, possibly a lack of appropriately rigorous analysis (if this isn't your specialty), and lack of ethical review and oversight. From an ethics perspective, you propose to use deception on uninformed participants while possibly obtaining personally identifiable information on them which could lead to them facing serious social consequences if they were identified. With the mob mentality of the viral internet as it is, the consequences could be pretty darn severe - up to loss of job, death threats, actual violence, and more. Sensitive topics require sensitive handling, which is what any functioning IRB and responsible researcher would insist on.



In reporting on the results, even if informally on a blog, you could be seen as offering a pseudo-scientific view (or worse) on a controversial and important topic. If your experiment was performed poorly or your analysis done improperly, you could lend weight to an incorrect view - either providing what could be cited as evidence that discrimination does not exist where it does (thus making it harder for people discriminated against to make changes or be taken seriously), or supporting the view that discrimination does exist where it doesn't (leading to negative consequences for people who are doing nothing wrong and deflecting attention away from more pressing, extant issues). Bad science, even done with good intention, can easily make the world worse.



If some random blogger or journalist did this, most of us can gratingly dismiss it as "they don't know any better", or just the world of click-bait, etc. But if you were a qualified scientist who should know better, people might not be so willing to dismiss such activity just because it wasn't intended to be scientific and it wasn't intended for publication. Most people won't even know the difference in what is and isn't intended to be scientific when done by a scientist, and many that do know the difference might not consider it an excuse.



As Dawn pointed out in a comment, one version of this is called an audit study, and there is a pretty large body of literature that tries to do basically what you are suggesting in a systematic way. I cannot even try to count how many studies of this sort are published, but I'd be surprised if it wasn't already in the thousands, looking at everything from gender to race to the impact of varying lengths of time gaps on a resume.



Finally, the nature of this sort of field study is that even with everything going your way they are hard to do correctly. No simple analysis method works even if you did everything right and collected all the data appropriately. There is too much randomness, too much heterogeneity, too much structure, to allow any simple bit of statistics to give the correct interpretation. In short, unless this is your specialty, it would be trivially easy to get everything else right and still come to exactly the wrong conclusion.



For those who are not familiar with this kind of statistics, a classic example of how a simple analysis can go wrong is Sex Bias in Graduate Admissions: Data from Berkeley. In a simple aggregate analysis, it looked quite clearly that women were being admitted at lower rates than men, and thus bias was quite obvious to the point that the deans of the school were concerned this could be the basis for a lawsuit. It turned out it was a nice example of Simpson's Paradox, as it turned out the cause for the difference was that women were more likely to apply to departments that were crowded and competitive and thus harder to get into for everyone, while men were more likely to apply to departments that were less competitive.



If a similar condition existed in the employment sector, where you were applying to jobs in industry that turned out to vary in their selectivity in a way that you were not considering, this would mess up your analysis, and you cannot easily collect more information that would allow you to fix it. After all, I'm sure you weren't inclined to use random selection in your own employment search!



So, in summation, the worst that I could imagine happening is: you end up doing bad science that would reflect badly on you and would not be easily excused just because it wasn't intended for publication; you come to the wrong conclusions and in a way which could hurt innocent people; you casually report information that could be used in dangerous and damaging way; you end up being identified as the person responsible and it goes viral, so now the most famous thing you'll ever be known for was this thing you didn't intend as a serious study (and which could have gone horribly wrong); and, as a bonus, you could just end up wasting your time and the time of others for no benefit.



And since its the worst thing that can happen, I suppose you could also end up with a headache. Things can always be worse by adding a headache.






share|improve this answer























  • Here, have two aspirin.

    – FrostedCentral
    14 mins ago















5














I like to think I have a pretty vivid imagination, so the worst thing I can reasonably imagine happening is that you would be seen as trying to perform an experiment with human participants without proper controls, questionable experimental design, possibly a lack of appropriately rigorous analysis (if this isn't your specialty), and lack of ethical review and oversight. From an ethics perspective, you propose to use deception on uninformed participants while possibly obtaining personally identifiable information on them which could lead to them facing serious social consequences if they were identified. With the mob mentality of the viral internet as it is, the consequences could be pretty darn severe - up to loss of job, death threats, actual violence, and more. Sensitive topics require sensitive handling, which is what any functioning IRB and responsible researcher would insist on.



In reporting on the results, even if informally on a blog, you could be seen as offering a pseudo-scientific view (or worse) on a controversial and important topic. If your experiment was performed poorly or your analysis done improperly, you could lend weight to an incorrect view - either providing what could be cited as evidence that discrimination does not exist where it does (thus making it harder for people discriminated against to make changes or be taken seriously), or supporting the view that discrimination does exist where it doesn't (leading to negative consequences for people who are doing nothing wrong and deflecting attention away from more pressing, extant issues). Bad science, even done with good intention, can easily make the world worse.



If some random blogger or journalist did this, most of us can gratingly dismiss it as "they don't know any better", or just the world of click-bait, etc. But if you were a qualified scientist who should know better, people might not be so willing to dismiss such activity just because it wasn't intended to be scientific and it wasn't intended for publication. Most people won't even know the difference in what is and isn't intended to be scientific when done by a scientist, and many that do know the difference might not consider it an excuse.



As Dawn pointed out in a comment, one version of this is called an audit study, and there is a pretty large body of literature that tries to do basically what you are suggesting in a systematic way. I cannot even try to count how many studies of this sort are published, but I'd be surprised if it wasn't already in the thousands, looking at everything from gender to race to the impact of varying lengths of time gaps on a resume.



Finally, the nature of this sort of field study is that even with everything going your way they are hard to do correctly. No simple analysis method works even if you did everything right and collected all the data appropriately. There is too much randomness, too much heterogeneity, too much structure, to allow any simple bit of statistics to give the correct interpretation. In short, unless this is your specialty, it would be trivially easy to get everything else right and still come to exactly the wrong conclusion.



For those who are not familiar with this kind of statistics, a classic example of how a simple analysis can go wrong is Sex Bias in Graduate Admissions: Data from Berkeley. In a simple aggregate analysis, it looked quite clearly that women were being admitted at lower rates than men, and thus bias was quite obvious to the point that the deans of the school were concerned this could be the basis for a lawsuit. It turned out it was a nice example of Simpson's Paradox, as it turned out the cause for the difference was that women were more likely to apply to departments that were crowded and competitive and thus harder to get into for everyone, while men were more likely to apply to departments that were less competitive.



If a similar condition existed in the employment sector, where you were applying to jobs in industry that turned out to vary in their selectivity in a way that you were not considering, this would mess up your analysis, and you cannot easily collect more information that would allow you to fix it. After all, I'm sure you weren't inclined to use random selection in your own employment search!



So, in summation, the worst that I could imagine happening is: you end up doing bad science that would reflect badly on you and would not be easily excused just because it wasn't intended for publication; you come to the wrong conclusions and in a way which could hurt innocent people; you casually report information that could be used in dangerous and damaging way; you end up being identified as the person responsible and it goes viral, so now the most famous thing you'll ever be known for was this thing you didn't intend as a serious study (and which could have gone horribly wrong); and, as a bonus, you could just end up wasting your time and the time of others for no benefit.



And since its the worst thing that can happen, I suppose you could also end up with a headache. Things can always be worse by adding a headache.






share|improve this answer























  • Here, have two aspirin.

    – FrostedCentral
    14 mins ago













5












5








5







I like to think I have a pretty vivid imagination, so the worst thing I can reasonably imagine happening is that you would be seen as trying to perform an experiment with human participants without proper controls, questionable experimental design, possibly a lack of appropriately rigorous analysis (if this isn't your specialty), and lack of ethical review and oversight. From an ethics perspective, you propose to use deception on uninformed participants while possibly obtaining personally identifiable information on them which could lead to them facing serious social consequences if they were identified. With the mob mentality of the viral internet as it is, the consequences could be pretty darn severe - up to loss of job, death threats, actual violence, and more. Sensitive topics require sensitive handling, which is what any functioning IRB and responsible researcher would insist on.



In reporting on the results, even if informally on a blog, you could be seen as offering a pseudo-scientific view (or worse) on a controversial and important topic. If your experiment was performed poorly or your analysis done improperly, you could lend weight to an incorrect view - either providing what could be cited as evidence that discrimination does not exist where it does (thus making it harder for people discriminated against to make changes or be taken seriously), or supporting the view that discrimination does exist where it doesn't (leading to negative consequences for people who are doing nothing wrong and deflecting attention away from more pressing, extant issues). Bad science, even done with good intention, can easily make the world worse.



If some random blogger or journalist did this, most of us can gratingly dismiss it as "they don't know any better", or just the world of click-bait, etc. But if you were a qualified scientist who should know better, people might not be so willing to dismiss such activity just because it wasn't intended to be scientific and it wasn't intended for publication. Most people won't even know the difference in what is and isn't intended to be scientific when done by a scientist, and many that do know the difference might not consider it an excuse.



As Dawn pointed out in a comment, one version of this is called an audit study, and there is a pretty large body of literature that tries to do basically what you are suggesting in a systematic way. I cannot even try to count how many studies of this sort are published, but I'd be surprised if it wasn't already in the thousands, looking at everything from gender to race to the impact of varying lengths of time gaps on a resume.



Finally, the nature of this sort of field study is that even with everything going your way they are hard to do correctly. No simple analysis method works even if you did everything right and collected all the data appropriately. There is too much randomness, too much heterogeneity, too much structure, to allow any simple bit of statistics to give the correct interpretation. In short, unless this is your specialty, it would be trivially easy to get everything else right and still come to exactly the wrong conclusion.



For those who are not familiar with this kind of statistics, a classic example of how a simple analysis can go wrong is Sex Bias in Graduate Admissions: Data from Berkeley. In a simple aggregate analysis, it looked quite clearly that women were being admitted at lower rates than men, and thus bias was quite obvious to the point that the deans of the school were concerned this could be the basis for a lawsuit. It turned out it was a nice example of Simpson's Paradox, as it turned out the cause for the difference was that women were more likely to apply to departments that were crowded and competitive and thus harder to get into for everyone, while men were more likely to apply to departments that were less competitive.



If a similar condition existed in the employment sector, where you were applying to jobs in industry that turned out to vary in their selectivity in a way that you were not considering, this would mess up your analysis, and you cannot easily collect more information that would allow you to fix it. After all, I'm sure you weren't inclined to use random selection in your own employment search!



So, in summation, the worst that I could imagine happening is: you end up doing bad science that would reflect badly on you and would not be easily excused just because it wasn't intended for publication; you come to the wrong conclusions and in a way which could hurt innocent people; you casually report information that could be used in dangerous and damaging way; you end up being identified as the person responsible and it goes viral, so now the most famous thing you'll ever be known for was this thing you didn't intend as a serious study (and which could have gone horribly wrong); and, as a bonus, you could just end up wasting your time and the time of others for no benefit.



And since its the worst thing that can happen, I suppose you could also end up with a headache. Things can always be worse by adding a headache.






share|improve this answer













I like to think I have a pretty vivid imagination, so the worst thing I can reasonably imagine happening is that you would be seen as trying to perform an experiment with human participants without proper controls, questionable experimental design, possibly a lack of appropriately rigorous analysis (if this isn't your specialty), and lack of ethical review and oversight. From an ethics perspective, you propose to use deception on uninformed participants while possibly obtaining personally identifiable information on them which could lead to them facing serious social consequences if they were identified. With the mob mentality of the viral internet as it is, the consequences could be pretty darn severe - up to loss of job, death threats, actual violence, and more. Sensitive topics require sensitive handling, which is what any functioning IRB and responsible researcher would insist on.



In reporting on the results, even if informally on a blog, you could be seen as offering a pseudo-scientific view (or worse) on a controversial and important topic. If your experiment was performed poorly or your analysis done improperly, you could lend weight to an incorrect view - either providing what could be cited as evidence that discrimination does not exist where it does (thus making it harder for people discriminated against to make changes or be taken seriously), or supporting the view that discrimination does exist where it doesn't (leading to negative consequences for people who are doing nothing wrong and deflecting attention away from more pressing, extant issues). Bad science, even done with good intention, can easily make the world worse.



If some random blogger or journalist did this, most of us can gratingly dismiss it as "they don't know any better", or just the world of click-bait, etc. But if you were a qualified scientist who should know better, people might not be so willing to dismiss such activity just because it wasn't intended to be scientific and it wasn't intended for publication. Most people won't even know the difference in what is and isn't intended to be scientific when done by a scientist, and many that do know the difference might not consider it an excuse.



As Dawn pointed out in a comment, one version of this is called an audit study, and there is a pretty large body of literature that tries to do basically what you are suggesting in a systematic way. I cannot even try to count how many studies of this sort are published, but I'd be surprised if it wasn't already in the thousands, looking at everything from gender to race to the impact of varying lengths of time gaps on a resume.



Finally, the nature of this sort of field study is that even with everything going your way they are hard to do correctly. No simple analysis method works even if you did everything right and collected all the data appropriately. There is too much randomness, too much heterogeneity, too much structure, to allow any simple bit of statistics to give the correct interpretation. In short, unless this is your specialty, it would be trivially easy to get everything else right and still come to exactly the wrong conclusion.



For those who are not familiar with this kind of statistics, a classic example of how a simple analysis can go wrong is Sex Bias in Graduate Admissions: Data from Berkeley. In a simple aggregate analysis, it looked quite clearly that women were being admitted at lower rates than men, and thus bias was quite obvious to the point that the deans of the school were concerned this could be the basis for a lawsuit. It turned out it was a nice example of Simpson's Paradox, as it turned out the cause for the difference was that women were more likely to apply to departments that were crowded and competitive and thus harder to get into for everyone, while men were more likely to apply to departments that were less competitive.



If a similar condition existed in the employment sector, where you were applying to jobs in industry that turned out to vary in their selectivity in a way that you were not considering, this would mess up your analysis, and you cannot easily collect more information that would allow you to fix it. After all, I'm sure you weren't inclined to use random selection in your own employment search!



So, in summation, the worst that I could imagine happening is: you end up doing bad science that would reflect badly on you and would not be easily excused just because it wasn't intended for publication; you come to the wrong conclusions and in a way which could hurt innocent people; you casually report information that could be used in dangerous and damaging way; you end up being identified as the person responsible and it goes viral, so now the most famous thing you'll ever be known for was this thing you didn't intend as a serious study (and which could have gone horribly wrong); and, as a bonus, you could just end up wasting your time and the time of others for no benefit.



And since its the worst thing that can happen, I suppose you could also end up with a headache. Things can always be worse by adding a headache.







share|improve this answer












share|improve this answer



share|improve this answer










answered 1 hour ago









BrianHBrianH

17k54071




17k54071












  • Here, have two aspirin.

    – FrostedCentral
    14 mins ago

















  • Here, have two aspirin.

    – FrostedCentral
    14 mins ago
















Here, have two aspirin.

– FrostedCentral
14 mins ago





Here, have two aspirin.

– FrostedCentral
14 mins ago

















draft saved

draft discarded
















































Thanks for contributing an answer to Academia Stack Exchange!


  • Please be sure to answer the question. Provide details and share your research!

But avoid


  • Asking for help, clarification, or responding to other answers.

  • Making statements based on opinion; back them up with references or personal experience.

To learn more, see our tips on writing great answers.




draft saved


draft discarded














StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2facademia.stackexchange.com%2fquestions%2f126930%2fa-social-experiment-what-is-the-worst-that-can-happen%23new-answer', 'question_page');

);

Post as a guest















Required, but never shown





















































Required, but never shown














Required, but never shown












Required, but never shown







Required, but never shown

































Required, but never shown














Required, but never shown












Required, but never shown







Required, but never shown







Popular posts from this blog

Dapidodigma demeter Subspecies | Notae | Tabula navigationisDapidodigmaAfrotropical Butterflies: Lycaenidae - Subtribe IolainaAmplifica

Constantinus Vanšenkin Nexus externi | Tabula navigationisБольшая российская энциклопедияAmplifica

Gaius Norbanus Flaccus (consul 38 a.C.n.) Index De gente | De cursu honorum | Notae | Fontes | Si vis plura legere | Tabula navigationisHic legere potes