Module 08Frontiers & Integration

⏱ 3–4h 📋 conceptual + synthesis 📌 Modules 1–7 🎯 Complete portfolio prototype



§ workbook

Learning Outcomes

# Module 8: Frontiers and Integration

Estimated time: 3–4 hours

Type: Conceptual + synthesis (workbook + portfolio builder)

Prerequisites: Modules 1–7 (or at least Modules 1 and 7, plus your chosen application modules)

What you'll produce: A complete portfolio prototype: task, baseline, experiment, evidence, decision, disclosure

1. Local and Open-Weight Models

Throughout this course, you have used AI through chat interfaces — models running on servers controlled by companies. There is an alternative: running models on your own hardware.

What are open-weight models?

An open-weight model is one whose trained parameters (the "weights" — the numerical result of training) are publicly available for download. Anyone with sufficient hardware can run the model. Examples include:

  • Llama (Meta)
  • Mistral (Mistral AI)
  • Qwen (Alibaba)
  • DeepSeek (DeepSeek AI)
  • OLMo (Allen Institute for AI)

These are distinct from "open source" in the traditional sense — the training data and code may not be public — but the model itself can be downloaded, inspected, modified, and run locally.

Why run models locally?

  1. Data stays on your device. No text you process is sent to an external server. This matters for confidential, sensitive, or restricted data (interview transcripts, administrative records, unpublished drafts).
  1. Reproducibility. You control the model version. A proprietary model accessed through an API can be updated, modified, or deprecated without notice. A file on your hard drive does not change.
  1. Cost. No per-token charges. The cost is your hardware and electricity.
  1. Customisation. You can fine-tune an open-weight model on your own data, adapting it to your domain, terminology, or task.

The trade-offs

  • Hardware requirements. Running a capable model requires a reasonably powerful computer, ideally with a dedicated GPU. Smaller models (1–8 billion parameters) run on consumer laptops. Larger models (70B+) need specialised hardware or cloud GPU rental.
  • Capability gap. The largest open-weight models are competitive with proprietary models on many tasks, but the most capable proprietary models (GPT-5, Claude 4, Gemini) still lead on complex reasoning, long-context tasks, and multilingual performance.
  • Setup overhead. Installing and running a local model requires some technical comfort — downloading model files, configuring software (LM Studio, Ollama, vLLM), and managing storage. It is not as simple as opening a website.

When local models make sense for research

  • Your data cannot leave your device (ethics, GDPR, institutional rules)
  • You need reproducible results over months or years
  • You are processing a large volume of text and API costs would be prohibitive
  • You want to fine-tune a model on domain-specific data

When proprietary models make sense

  • You need the highest available capability for a complex task
  • Your data is not sensitive and can be transmitted
  • You are doing exploratory work where speed of iteration matters more than long-term reproducibility
  • You lack the hardware or technical comfort to run models locally

The course position: Neither choice is "better." The choice should be justified in your disclosure, with the trade-offs stated. "Convenience" is not a methodological justification — but "the task required multilingual capability that available open-weight models do not provide at sufficient quality" is.


2. Multimodal AI

Everything in Modules 1–7 has been about text. But AI systems increasingly handle images, audio, and video as well.

What multimodal models can do

  • Image analysis: Describe what is in a photograph, extract text from a scanned document (OCR), identify objects, read charts and graphs
  • Image generation: Create images from text descriptions (DALL-E, Midjourney, Stable Diffusion)
  • Audio transcription and analysis: Convert speech to text, identify speakers, detect emotion or sentiment in voice
  • Video understanding: Summarise video content, detect scene changes, track objects across frames

Relevance to social science research

Multimodal AI opens research possibilities that were previously impractical at scale:

  • Visual content analysis: Classify images in social media posts, news photographs, or political advertisements — not just their captions
  • Protest event detection: Scan video footage for crowd size estimation, sign text extraction, or police-protester interaction coding
  • Archival research: Transcribe and translate handwritten documents, historical audio recordings, or microfilm scans
  • Accessibility: Generate image descriptions for visually impaired researchers or study participants

The same principles apply

Multimodal models are still prediction engines. They can miscaption an image, hallucinate text that is not in a document, or misidentify an object. Every validation principle from Module 7 applies: verify against human judgment, test on known cases, check whether errors are systematic, and disclose what was used.

The boundaries

  • Consent and privacy: Processing images or audio of people raises privacy concerns that text processing does not. Do not upload identifiable images or recordings without consent.
  • Copyright: Generated images may reproduce elements of copyrighted training data. Using AI-generated images in publication may raise rights issues.
  • Deepfake concern: The same technology that analyses media can synthesise it. Researchers using multimodal AI should be aware of how their work could be mischaracterised or misused.

3. Ethics, Governance, and Institutional Boundaries

AI use in research operates within institutional, legal, and ethical frameworks. You are responsible for knowing the ones that apply to your work.

Key frameworks

European Research Area (ERA). Living Guidelines on the Responsible Use of Generative AI in Research (updated May 2026). The factsheet version covers: researchers remain accountable; AI use must be transparent; peer review cannot be delegated; data protection applies. Read it — it is short and directly applicable.

University of Zurich. Recommendations on the Use of Generative Artificial Intelligence (September 2023). Implements seven guiding principles: responsibility, transparency, data protection, quality assurance, fairness, sustainability, and human oversight. Available at uzh.ch/en/explore/basics/ai/recommendations.html.

Swiss National Science Foundation (SNSF). Statement on AI in funding applications (February 2024). The key paragraph: applicants are responsible for content produced with AI assistance; reviewers cannot use AI to evaluate proposals; confidentiality of third-party data must be preserved.

Journal policies. American Journal of Political Science (AJPS) AI Policy (June 2025) and American Political Science Review (APSR) author instructions: AI use must be disclosed; AI cannot be an author; AI-generated references must be verified; reviewers cannot upload manuscripts to AI tools.

The principles that cut across all frameworks

  1. You are accountable. A tool cannot be a co-author, cannot be cited as a source of fact, and cannot absorb responsibility for an error.
  2. Disclose. Name the tool, the purpose, and the location in the work. The disclosure must be specific enough that a reviewer can evaluate it.
  3. Protect data. Do not upload material you lack the authority to share: unpublished co-authored drafts, interview transcripts, administrative data, identifiable records.
  4. Verify. AI-generated references, claims, and analyses must be checked by a human before submission.
  5. Preserve human judgment. Peer review, grading, and final editorial decisions must be made by people.

4. Building Your Workflow: Integration

The eight modules of this course are designed to be combined. A real research workflow typically involves several of them:

  • Module 2 (Writing) + Module 7 (Validation): Draft a paper section with AI assistance, then verify claims, citations, and argument structure against the evidence framework.
  • Module 3 (Literature) + Module 4 (Annotation): Search for and screen papers, then classify them by method, finding, or relevance using a codebook.
  • Module 4 (Annotation) + Module 5 (Code/Data): Generate labels with an LLM, then analyse the labelled dataset using AI-assisted code — and verify every step.
  • Module 6 (Agents) + Module 7 (Validation): Design an agent workflow, run it, and audit the output against the seven validation checks.
  • Module 3 (Literature) + Module 6 (Agents): Build a literature-search agent with persistent instructions, then inspect the screening transcript.

The portfolio asks you to integrate at least two modules into a coherent workflow for a task from your own research.

The integration checklist

Before you finalise your workflow, verify:

  • [ ] Every AI-assisted step has a named human check
  • [ ] The evidence for each claim is traceable to a verified source or a documented computation
  • [ ] The disclosure names every tool, model, date, and purpose
  • [ ] The four questions are answerable for every delegated task
  • [ ] The validation plan uses checks from the menu (Module 7) appropriate to the claims
  • [ ] Data boundaries are respected — nothing uploaded that you lack authority to share
  • [ ] The workflow can be described in a methods section a reviewer could evaluate

5. The Portfolio: Your Final Integration

The portfolio is the course's capstone. It answers one question:

Where, if anywhere, should AI enter my research workflow, under what conditions, and on the basis of what evidence?

Your answer takes one of four forms:

  • Integrate the use into your workflow
  • Integrate with limits — specify the conditions, checks, and boundaries
  • Continue experimenting — the evidence is promising but not yet sufficient
  • Do not integrate — the evidence does not support adoption for this task

All four conclusions can be equally strong. The grade depends on the quality of the evidence and reasoning, not on whether you adopted AI.

Portfolio structure

  1. Research task and baseline (~1 page): What is the task? How do you currently do it? What does success and failure mean for this task?
  1. Proposed AI use (~1 page): What exactly would the AI do? What judgment is being delegated and what is retained? What data, ethics, or institutional constraints apply?
  1. Experiment (~2 pages): What claim did you test? What was your comparison? What tool, model, date, instructions, and settings? What did you predict before running? What evidence did you preserve?
  1. Evidence and failures (~1 page): What did the experiment show? What checks did you run? What failed, was uncertain, or was limited? Why do the failures matter for the research claim?
  1. Decision (~1 page): "On the evidence I have, I will…" and "I would change this decision if…" Be specific about the condition that would change your mind.
  1. Revised workflow and disclosure (~1 page): The resulting workflow in any readable form, with who/what performs each step, what check applies, what record remains, and what happens when a check fails. Plus a disclosure paragraph suitable for a methods section.

What earns credit

  • A bounded task with a meaningful baseline
  • A credible comparison or experiment
  • External evidence — not just the model's output
  • Attention to failure, variation, and boundary cases
  • A decision supported by evidence, with a stated condition for changing it
  • Transparent documentation

What does not earn credit

  • Using many tools rather than one well-evaluated one
  • Long or technically complex workflows
  • Polished model output presented as evidence
  • The fact of adoption (integrate is not better than do not integrate)
  • Claiming a human was "in the loop" without showing what the human could reject or change

6. The Four Questions, One Last Time

Apply them to your completed portfolio:

  1. What is being delegated? In your final workflow, name every task and every decision — and who or what performs each.
  2. What would make the result believable? For each delegated step, name the external evidence that supports it. If you cannot name it, you have not verified it.
  3. What could be lost or flattened? What variation, minority perspective, ambiguity, or tacit knowledge does your AI-assisted workflow handle differently — or not at all — compared to your baseline?
  4. What must remain visible or human? What decisions, checks, and records survive outside the model's context window? If a reviewer cannot inspect them from your disclosure, they do not survive.

7. Summary

  • Open-weight models offer data locality, reproducibility, and cost advantages — at the cost of hardware requirements and some capability gap. The choice requires justification.
  • Multimodal AI extends the same principles (and the same validation requirements) to images, audio, and video.
  • Institutional frameworks (ERA, UZH, SNSF, journals) converge on five principles: accountability, disclosure, data protection, verification, and human judgment.
  • Integration means combining modules into a coherent workflow where every AI-assisted step has a named human check and every claim traces to verifiable evidence.
  • The portfolio is your answer to the course's governing question. The quality of your evidence and reasoning determines the answer's strength — not whether you adopted AI.

8. The Course, In One Paragraph

AI can make research faster, larger, and more ambitious. It can also make it sloppier, less transparent, and harder to reproduce — and the same tool can do both, depending on how it is used. The difference is not the model, the interface, or the prompt. It is the researcher's willingness to ask what is being delegated, to demand evidence from outside the system, to watch for what is lost or flattened, and to keep visible what must remain human. That is the method. The tool is just the tool.


§ exercises

# Module 8: Exercises

Exercise 8.1: Model Choice Justification

Goal: Practice justifying a model choice for a research task.

For your portfolio task, write a 2–3 sentence justification for your model choice. Your justification must address:

  • Why this model? (capability, accessibility, data locality, cost, reproducibility — not "convenience")
  • What alternatives did you consider? (name at least one)
  • What trade-offs did you accept? (capability, privacy, cost, reproducibility)

Your justification: _______________


Answer Key (click to expand)

A good justification is specific and honest about trade-offs:

Strong: "I used Claude 4 (Anthropic, via API, 15 October 2026) because the classification task required handling 50,000 abstracts with consistent output formatting, and Claude provides structured output capabilities that available open-weight models at similar parameter counts do not reliably produce. The trade-off is that the data was transmitted to Anthropic's servers; the abstracts are publicly available and contain no sensitive information. For a replication, the prompt and sampling parameters are preserved; the specific model version may not be available indefinitely."

Weak: "I used ChatGPT because it's free and easy." (No justification of capability, no alternatives considered, no trade-offs acknowledged.)

The point is not to defend a particular choice. It is to show that you made a choice — rather than using whatever was at hand — and that you understand what you gained and lost.


Exercise 8.2: Data Boundary Classification

Goal: Practice identifying what can and cannot be uploaded to external AI services.

Classify each data type according to the four-pile framework from Module 7:

| Data type | Classification |

|---|---|

| Published journal article abstracts from OpenAlex | |

| Unpublished co-authored draft with identifiable informant quotes | |

| Your own field notes from public observations (no names) | |

| Administrative dataset with individual-level health records | |

| A dataset you downloaded from a public repository (ICPSR) | |

| Interview transcripts where participants gave written consent for analysis | |

| Tweets collected via the X API (public accounts) | |

| Your thesis draft before submission | |

Classifications: Safe / Safe after transformation / Not safe / Uncertain (ask supervisor)


Answer Key (click to expand)

| Data type | Classification | Reasoning |

|---|---|---|

| Published abstracts | Safe | Already public; no privacy concern. |

| Unpublished co-authored draft with quotes | Not safe | Co-author has not consented; informants may be identifiable. |

| Field notes from public observations | Safe after transformation | Remove any identifiers; verify no one can be re-identified from context. |

| Health records | Not safe | GDPR-protected; even de-identified health data requires specific consent and institutional approval. |

| ICPSR dataset | Safe after transformation | Check the ICPSR terms of use — some datasets prohibit upload to third-party services even if public. |

| Interview transcripts with consent | Uncertain | Consent for analysis is not consent for upload to an AI provider. Check the consent form and ethics approval. |

| Public tweets | Safe after transformation | X API terms may restrict redistribution. Check the terms; if in doubt, do not upload raw data — process locally. |

| Thesis draft | Uncertain | Your own work, but if it contains unpublished data, co-authored material, or sensitive findings, treat as not safe. Many universities have specific policies on thesis drafts and AI. |

The key principle: "Public" does not mean "I can upload it anywhere." Platform terms of service, ethics approvals, co-author consent, and institutional policies all apply. When in doubt, ask your supervisor — not the AI.


Exercise 8.3: Write Your "I Would Change This Decision If…"

Goal: Articulate the condition that would change your portfolio decision.

Your portfolio requires a decision statement and a change condition. The condition must be specific enough that someone else could tell whether it had been met.

Weak: "I would change this decision if new evidence emerged." (Too vague — what evidence?)

Weak: "I would change this decision if the technology improved." (Too vague — what improvement?)

Strong: "I would change this decision if a human-model reliability study on my specific codebook showed kappa ≥ 0.80 on a sample of at least 200 items, with no category having recall below 0.85."

Write your change condition:

"I would change this decision if…" _______________


Answer Key (click to expand)

A good change condition is:

  • Specific: Names the evidence that would change your mind
  • Observable: Someone else could check whether it has been met
  • Proportionate: The evidence required matches the decision at stake
  • Not impossible: A condition that can never be met ("if the model becomes perfect") is not a condition — it is a refusal to reconsider

Examples by decision type:

  • Do not integrate → Integrate: "I would integrate LLM-based screening if a comparison study on my dataset showed recall ≥ 0.95 for relevant papers, with no more than 5% of excluded papers being false negatives, on a sample of at least 500 records."
  • Integrate with limits → Integrate fully: "I would remove the human-review step if two independent model runs produced identical labels on ≥ 98% of records for three consecutive batches of 1,000 items each."
  • Integrate → Integrate with limits: "I would add a human verification step if the model's accuracy on boundary cases (ambiguous abstracts) fell below 80% in a quarterly audit of 100 randomly selected cases."


Exercise 8.4: Build Your Portfolio Prototype

Goal: Assemble the six sections of your portfolio using work from previous modules.

Using the template from the workbook (Section 5), draft each section. Where possible, pull material from your module exercises:

| Portfolio section | Source material |

|---|---|

| 1. Research task and baseline | Capability map (Module 1, Exercise 1.5) |

| 2. Proposed AI use | Four questions applied (Module 1, Exercise 1.3; and domain modules) |

| 3. Experiment | Any module exercise where you tested an AI use |

| 4. Evidence and failures | Validation exercises (Module 7) + error analyses from domain modules |

| 5. Decision | Exercise 8.3 above |

| 6. Revised workflow and disclosure | Disclosure exercises (Module 2, Module 7) + workflow design (Module 6) |

Write a complete first draft. It does not need to be final — but it should be complete enough that a peer could read it and identify the strongest and weakest pieces of evidence.


Answer Key (click to expand)

The portfolio is your work — there is no correct answer beyond the rubric. But check your draft against these quality criteria:

  • Section 1: The task is specific and bounded. The baseline is real — what you actually do now, not a straw man. Success and failure are defined in terms that matter for research, not for the tool.
  • Section 2: The AI's role is precisely described. Task and decision are separated. Constraints (data, ethics, institutional) are named.
  • Section 3: There is a comparison — not just "I tried AI and it worked." The prediction before the run is stated. The materials (prompt, model, date, settings) are preserved.
  • Section 4: Evidence comes from outside the model — human comparison, source verification, repeated runs, or another check. At least one failure or limitation is reported, and its consequence for the research claim is explained.
  • Section 5: The decision matches the evidence — not stronger, not weaker. The change condition is specific and observable.
  • Section 6: The workflow is readable. Every step has a named actor (human or model). Checks are specified. A reviewer could evaluate the disclosure.


Exercise 8.5: The Course Reflection

Goal: Consolidate what you have learned and identify what to investigate next.

Answer briefly:

  1. What is the most important thing you learned in this course? _______________
  2. What surprised you most about how AI performed on a research task? _______________
  3. What one AI capability do you want to explore further after this course? _______________
  4. What one AI capability do you think is overhyped for social science research? _______________
  5. What will you do differently in your next research project because of this course? _______________

Answer Key (click to expand)

There is no correct answer — this is a reflection, not a test. But strong reflections tend to:

  • Reference specific experiences (a particular exercise, a surprising model output, a failed experiment)
  • Distinguish what they observed from what they expected
  • Identify a concrete next step, not a vague intention to "use AI more"
  • Show awareness of both capability and limitation — neither uncritical enthusiasm nor blanket rejection

The reflection is for you. It is not submitted or graded.


Module 8 Exercises · AI as a Research Tool


§ readings

---

Core Readings

European Research Area. Living Guidelines on the Responsible Use of Generative AI in Research (updated 8 May 2026).

Why read it: The most current European-level guidance on AI in research. Covers accountability, transparency, data protection, and peer review. The factsheet version is short and directly applicable to your portfolio. What to take: Four principles: researchers remain accountable; AI use must be transparent; peer review cannot be delegated to AI; data protection and confidentiality apply to AI tools as they do to any other research tool. ---

University of Zurich. Recommendations on the Use of Generative Artificial Intelligence (September 2023).

Why read it: Your institution's policy. Seven guiding principles: responsibility, transparency, data protection, quality assurance, fairness, sustainability, and human oversight. Available at uzh.ch/en/explore/basics/ai/recommendations.html. What to take: The principles are high-level, but they establish the expectations. Your portfolio disclosure should demonstrate how your workflow satisfies them. ---

Swiss National Science Foundation. "The SNSF's Approach to the Use of Artificial Intelligence in Funding Applications" (28 February 2024).

Why read it: The funder's rules. Key paragraphs: applicants are responsible for AI-produced content; reviewers cannot use AI to evaluate proposals; confidentiality of third-party data must be preserved. What to take: If you are writing an SNSF application, these rules apply directly. Even if you are not, they represent the standard that funding bodies are converging toward. ---

American Journal of Political Science. AI Policy (17 June 2025); American Political Science Review. Author Instructions, AI Section.

Why read it: The publication standards. AJPS and APSR require AI use disclosure, prohibit AI as author, and require verification of AI-generated references. These policies are models for what other journals will adopt. What to take: Your portfolio disclosure should meet the standards these journals set. If a journal editor could not evaluate your AI use from your disclosure, it is not adequate. ---

Frontier Readings

Touvron, H., et al. (2023). "Llama 2: Open Foundation and Fine-Tuned Chat Models." arXiv:2307.09288.

Why read it: The paper that accompanied the release of Llama 2, one of the most widely used open-weight models. Read the introduction and the safety/limitations sections — not the technical architecture. What to take: Open-weight models are released with documentation about their capabilities, limitations, and intended uses. Read it — the same critical evaluation you apply to AI output should be applied to the model's own claims about itself. ---

Birhane, A., et al. (2024). "Into the LAION's Den: Investigating Hate in Multimodal Datasets." Advances in Neural Information Processing Systems, 37.

Why read it: An investigation of problematic content in a large multimodal training dataset. Relevant because multimodal models inherit the biases and content of their training data. What to take: Multimodal AI is not neutral. The images a model was trained on shape what it can "see" and how it classifies what it sees. The same critical framework you apply to text output applies to image descriptions and classifications. ---

Integration and Portfolio Readings

Bail, C. A. (2024). "Can Generative AI Improve Social Science?" PNAS, 121(21).

Why read it: The optimistic case. Read together with Grossmann et al. (2023) for the debate. Both papers were listed in Module 1; now, with all eight modules behind you, you can evaluate their arguments against your own experimental evidence. What to take: Bail argues AI can expand the scope and scale of social science. After this course, you should be able to evaluate that claim for your own research area: expand in what way? At what cost to validity? With what evidence? ---

Grossmann, I., et al. (2023). "AI and the Transformation of Social Science Research." Science, 380(6650).

Why read it: The cautious case. Read with Bail (2024). Grossmann et al. emphasise the risks: loss of theoretical grounding, over-reliance on inductive pattern-finding, and the erosion of methodological standards. What to take: The debate between Bail and Grossmann is not about whether AI is useful — it is about under what conditions and with what safeguards. Your portfolio is your contribution to that debate, applied to your own research. ---

Doshi, A. R., & Hauser, O. P. (2024). "Generative AI Enhances Individual Creativity but Reduces the Collective Diversity of Novel Content." Science Advances, 10(28).

Why read it: The diversity finding. AI helps individuals produce more creative output, but when everyone uses similar AI tools, the collective output becomes more homogeneous. This is the "everyone sounds the same" problem. What to take: Your workflow should preserve what is distinctive about your research — your theoretical framework, your methodological choices, your voice. If AI makes your work more like everyone else's, you have lost something consequential. ---

Christin, A. (2020). "The Ethnographer and the Algorithm: Beyond the Black Box." Global Perspectives, 1(1).

Why read it: Revisit from Module 6. Now that you have designed a workflow and built an instruction artifact, Christin's argument about opacity as a choice — not a technical necessity — should resonate differently. What to take: Your disclosure and audit trail make your workflow less of a black box. The question is whether you have made it transparent enough that a reviewer can evaluate it. ---

Optional: Going Further

Bender, E. M., Gebru, T., McMillan-Major, A., & Shmitchell, S. (2021). "On the Dangers of Stochastic Parrots." Revisit from Module 1.

Why read it again: After eight modules of working with LLMs, return to the foundational critique. Do you agree more, less, or differently than when you first read it? ---

Kapoor, S., & Narayanan, A. (2023). "Leakage and the Reproducibility Crisis." Revisit from Modules 1 and 6.

Why read it again: The reproducibility argument applies to every module. After building your own workflow, evaluate: would it survive the leakage and reproducibility critiques Kapoor and Narayanan raise? --- Module 8 Reading List · AI as a Research Tool