{"attempt":1,"datasets":{"soules_call_to":{"description_shown":"This dataset is a cross-sectional rebel-group-level file that integrates original measures of recruitment appeals from the Rebel Appeals and Incentives Dataset (RAID) with standardized indicators of rebel ideology, organizational features, and country-level context for 232 rebel movements active worldwide between 1989 and 2011. Each record corresponds to a distinct rebel organization and captures both the breadth and composition of its grievance-based recruitment appeals, as well as its ideological profile, strength, territorial control, ethnic composition, and the regime and economic environment in which it operates.\n\nVariable descriptions\nnew_side_b_id: Numeric group identifier that uniquely references each rebel organization in the merged file, harmonizing the RAID units with the underlying non-state actor and replication identifiers used for statistical analysis.\nccode: Numeric country code indicating the primary state within which the rebel group is active, enabling linkage to country-level democracy and GDP covariates and the clustering of standard errors by conflict country.\nideol_ord: Ordinal indicator capturing the group\u2019s core ideology type as used in the models (e.g., distinguishing radical Islamist from other ideological families) to operationalize the main explanatory contrast in the paper.\nother_rel_appeals: Dichotomous RAID-based indicator coded 1 if the group sometimes employs recruitment appeals to non-Islamist religious ideologies (e.g., generic religious or non-radical faith-based claims), and 0 otherwise.\nleft_appeals: Binary variable denoting whether the group recruits using left-wing or communist ideological appeals, such as references to Marxist principles or anti-capitalist class struggle.\nanti_resource_appeals: Indicator coded 1 when rebel recruitment materials highlight opposition to the exploitation of local resources by external actors, including grievances about plunder or unequal resource extraction.\ngov_violence_appeals: Binary measure for appeals centered on violent government repression and human rights abuses, where recruitment narratives emphasize state-perpetrated killings, torture, or indiscriminate attacks.\nfeminist_appeals: Indicator for appeals invoking women\u2019s rights or gender inequality as a recruitment theme, such as mobilizing against gendered exclusion or violence.\nother_appeals: Catch-all binary category capturing miscellaneous recruitment appeals that do not fit the primary ideological or grievance types but nonetheless appear as recurring frames in the group\u2019s propaganda.\nethnic_nat_appeals: Dichotomous RAID measure indicating whether the group mobilizes recruits using ethnonationalist or regional grievances, such as discrimination against a specific ethnic community or demands for national self-determination.\nanti_intervention_appeals: Binary indicator coded 1 when groups employ recruitment appeals opposing foreign military intervention or occupation, including denunciations of external troops or international coalitions.\ngov_grievance_appeals: Variable marking general anti-government grievance appeals, where recruitment emphasizes corruption, misrule, or broad political injustices without being limited to a single policy issue.\nmulti_ethnic: Dichotomous measure from RAID indicating whether the group\u2019s membership is multi-ethnic, capturing heterogeneity in the ethnic background of recruits rather than whether ethnicity is the explicit basis of mobilization.\nsecessionist: Binary indicator of whether the organization has secessionist aims, that is, whether it seeks to create an independent state separate from the existing central government.\nreb_strength_ord: Ordinal measure of relative rebel strength taken from the NSA dataset, capturing expert assessments of whether the group is weaker, roughly equal, or stronger relative to government forces.\nname: Text string with the full or commonly used name of the rebel organization, preserving interpretable labels alongside numeric identifiers for substantive interpretation and replication.\nmulti_appeals: Binary summary indicator coded 1 if the group uses two or more distinct recruitment appeals (across the RAID dimensions), operationalizing whether recruitment is diversified versus narrow.\nterr_cont: Dichotomous measure for whether the group controls territory at any point, indicating de facto governance or sustained physical control of areas as captured in the NSA data.\nany_nr_binary: Indicator for whether the group exploited any natural resources (e.g., lootable or extractive commodities) during its life, derived from the Rebel Contraband Dataset and collapsed into a yes/no measure.\nappeals_count: Count variable measuring the total number of distinct recruitment appeals coded for the group across the RAID dimensions, ranging from 0 (no grievance-based appeals, only material incentives) to higher values for groups with more diverse appeals.\nother_group_binary: Binary measure capturing whether another rebel group was present in the same country when this group entered the armed conflict dataset, providing a simple indicator of inter-rebel competition.\nleft_wing: Dichotomous indicator (from WARD/FORGE) for whether the organization has a communist or broader left-wing founding ideology, used both as a control and for constructing alternative measures of ideological diversity.\nsupporttype_funds_rebel: Binary variable indicating whether the group received financial support from external actors (e.g., state sponsors or foreign patrons), based on external support data on rebel funding.\nradical_islamist: Core binary explanatory variable coded 1 for groups with a radical Islamist ideology\u2014those espousing goals such as establishing an Islamic state, enforcing religious law, or defending Islam\u2014and 0 otherwise.\nforeign_f: Dichotomous indicator of whether the group recruits foreign fighters, based on external foreign-fighter datasets and used to test how internationalization of recruitment conditions appeal diversity.\nv2x_polyarchy: Continuous country-level democracy score (polyarchy index) for the group\u2019s main country, capturing the extent of electoral competition and participation and serving as a control for regime type.\nmean_log10_gdp_pc: Continuous measure of average logged GDP per capita in the group\u2019s host country over its active period, capturing income levels and included as a macroeconomic control.\ngroup_age: Numeric variable measuring the age or duration of the group (e.g., years active), used as a control to account for the possibility that older organizations have had more time to diversify appeals.\nideology_forge_count: Count of the number of distinct founding ideologies attributed to the group in the FORGE dataset (e.g., religious, nationalist, left-wing), used in robustness checks on broader ideological diversity.\nincompatible_appeals: Binary measure constructed by examining all pairwise correlations among appeals in RAID and coding 1 if the group employs at least one pair of appeals that are negatively and significantly associated in the full sample, indicating that it combines appeals most groups avoid mixing.\npost_2003: Dichotomous indicator taking value 1 for groups active after 2003, capturing the post\u2013Iraq invasion period in which transnational jihadist dynamics and perceptions of threats to Islam intensified.\nideology_count: Count variable summarizing the number of ideologies a group represents across external ideology datasets (e.g., socialism, Islamism, nationalism), used in robustness checks on ideological diversification beyond recruitment appeals.\nappeals_count_restrict: Alternative, more restrictive count of recruitment appeals that excludes appeals corresponding to the group\u2019s parent ideology (e.g., omitting Islamist appeals for Islamist groups), used to test whether results hold when focusing on \u201cnon-core\u201d grievances.\nmulti_appeals_restrict: Binary version of the restrictive count, coded 1 if the group makes two or more non-parent appeals, allowing analyses of diversified grievance framing net of primary ideology.\nyear_start: Calendar year in which the group first appears in the armed conflict or non-state actor data, anchoring the onset of its conflict activity and the period over which contextual covariates are averaged or coded.\nyear_end: Calendar year in which the group exits the dataset (e.g., due to dissolution, defeat, or end of recorded activity), marking the end of its observed life span for the purposes of computing group age and averaging country-level variables.","file_sha256":"98f408c51ef5d93f296879abc4a896f99ff204c566c714c7a77a9359218f78af","frame_sha256":null,"role":"agent","transforms":[]}},"epoch":1,"event":"sample_init","question":"Does being a radical Islamist group causally increase the number of recruitment appeals they make?","question_sha256":"d8ddb2501d33f9a560fd7a1d6a3f26654bb11242e43d4c4193fea0585af679b7","run_id":"20261015T171142Z-suite-causcibench_real-naive-d6494d","seq":0,"skills":[],"task_id":"causcibench_real.q124","task_sha256":"02636e369c011587b73553bb10fb0ec950742fa9a72a7c56b255d8ea97df1970","timestamp":"2026-10-15T17:11:45.066048Z"}
{"attempt":1,"attempts":[],"call_id":"call_0d7c9512","epoch":1,"event":"model","finish_reason":"tool_use","latency_ms":0.0,"model_reported":"naive-ols","model_requested":"naive-ols","provider":"scripted","request":{"config":{},"contents_refs":[],"messages_refs":["7e89c4b4b1abc60585d62980b2a3c7cf35edf64c5ceb21febf319ff9a94c37e6"],"system_stable_ref":"433a6877aa6a378bbd4b7e2752e484d8cb7499c562d68222be231f62ff2fa420","system_task_ref":"477333cc8c62c439f2c5af8d440c46066c7a774159da27ed7f968eece6af21b0","tools_ref":"52ab03d8ec104abb85572294bf8a469d75c5de9e74d6042caabff8017adc572b"},"response":{"text":"Linha de base ing\u00eanua: regress\u00e3o do resultado no tratamento, sem controles.","thoughts":null,"tool_calls":[{"args":{"dataset":"soules_call_to","x":["radical_islamist"],"y":"appeals_count"},"llm_name":"infer__ols","tool_id":"infer.ols","vendor_id":"script_1"}]},"response_id":null,"run_id":"20261015T171142Z-suite-causcibench_real-naive-d6494d","seq":1,"task_id":"causcibench_real.q124","timestamp":"2026-10-15T17:11:45.066048Z","usage":{"cached":0,"input":0,"output":0,"thoughts":0},"vendor":false}
{"arguments":{"cluster":null,"controls":[],"dataset":"soules_call_to","fe":[],"intercept":true,"level":0.95,"se":"HC1","subset":null,"weights":null,"x":["radical_islamist"],"y":"appeals_count"},"attempt":1,"cached":false,"call_id":"call_df5fe7e4","card_version":"0.1.0","code_version":"2925aeab2262","dataset_digests":{"soules_call_to":"ecaf23cddc67125147defa7c08b7937c8fdf1e087f3c956da1f5a27cefb1e00c"},"decided_by":"model","duration_ms":2.0929588936269283,"epoch":1,"error":null,"event":"tool","informed_by":[],"input_digest":"d4352679320ef3811453f4f0c5ab1eb2098001ab523fcb0ee40e232a7c1e0afd","llm_name":"infer__ols","output_digest":"2c64fa7c837c50db6d9d28526f7608772ee77b55d2faecce8476cf5d57ff3c49","rationale":"Linha de base ing\u00eanua: regress\u00e3o do resultado no tratamento, sem controles.","replay_class":"replayed","result":{"assumptions":["the conditional mean of the outcome is linear in the regressors","errors are independent across observations; their variance may differ"],"call_id":"call_df5fe7e4","datasets":{},"diagnostics":[{"flag":false,"name":"n_obs","note":"observations used","value":232},{"flag":false,"name":"k","note":"parameters estimated, fixed-effect dummies included","value":2},{"flag":false,"name":"r2","note":"","value":0.09708649178424955},{"flag":false,"name":"df_resid","note":"","value":230},{"flag":false,"name":"se_type","note":"heteroskedasticity-robust standard errors (HC1)","value":"HC1"},{"flag":false,"name":"n_clusters","note":"errors not clustered","value":null}],"figures":[{"ci_high":1.0105700131293964,"ci_level":0.95,"ci_low":0.4527266901673069,"derivation":{"note_pt":"","steps":[{"formula":"","result":0.7316483516483516,"terms":[{"note":"","symbol":"n","unit":"observa\u00e7\u00f5es","value":232.0},{"note":"","symbol":"k","unit":"par\u00e2metros","value":2.0}],"text_pt":"Coeficiente de radical_islamist na regress\u00e3o por m\u00ednimos quadrados ordin\u00e1rios de appeals_count.","unit":""},{"formula":"ep = \u221aV_jj","result":0.1415607590885176,"terms":[{"note":"diagonal da matriz de covari\u00e2ncia","symbol":"V_jj","unit":"","value":0.020039448513717317}],"text_pt":"Erro-padr\u00e3o robusto \u00e0 heterocedasticidade (HC1): a raiz da vari\u00e2ncia estimada do coeficiente.","unit":""},{"formula":"IC = \u03b2 \u00b1 c \u00b7 ep","result":null,"terms":[{"note":"","symbol":"\u03b2","unit":"","value":0.7316483516483516},{"note":"quantil 0.975","symbol":"c","unit":"","value":1.9703317732750762},{"note":"","symbol":"ep","unit":"","value":0.1415607590885176}],"text_pt":"Intervalo de 95% de confian\u00e7a: a estimativa mais ou menos o valor cr\u00edtico da distribui\u00e7\u00e3o t de Student com 230 graus de liberdade vezes o erro-padr\u00e3o.","unit":""}]},"key":"coef.radical_islamist","label":"Coefficient on radical_islamist in the regression of appeals_count","se":0.1415607590885176,"unit":"","value":0.7316483516483516}],"notes":"","reason":"","status":"ok","tables":{"coefficients":[{"ci_high":1.7848039139148364,"ci_low":1.5118993827884601,"coef":1.6483516483516483,"p":5.6856559730357775e-64,"se":0.06925344625406807,"t":23.8017273870298,"term":"Intercept"},{"ci_high":1.0105700131293964,"ci_low":0.4527266901673069,"coef":0.7316483516483516,"p":5.121031550383857e-07,"se":0.1415607590885176,"t":5.168440437585205,"term":"radical_islamist"}]},"tool":"infer.ols","version":"0.1.0","warnings":[]},"result_for_model_ref":"4f29e0b4893f408297aeb868d5209638c9a7c208f6ecea4499903ec2e99e499f","result_sha256":"3de6b8a35545a99ab823a5b0182507f6ece17b4c86d5203ee40b00fa4d83fda1","run_id":"20261015T171142Z-suite-causcibench_real-naive-d6494d","seq":2,"synthetic":false,"task_id":"causcibench_real.q124","timestamp":"2026-10-15T17:11:45.068544Z","tool_id":"infer.ols","turn_id":"call_0d7c9512"}
{"attempt":1,"attempts":[],"call_id":"call_8bbab562","epoch":1,"event":"model","finish_reason":"tool_use","latency_ms":0.0,"model_reported":"naive-ols","model_requested":"naive-ols","provider":"scripted","request":{"config":{},"contents_refs":[],"messages_refs":["7e89c4b4b1abc60585d62980b2a3c7cf35edf64c5ceb21febf319ff9a94c37e6","3a47df9b118c70da7f8ca898c78f2cd5c6bc3f29c34a9cad4f743a65ad634b2e","cb48cfaa0fd6bc805e26d43ff6b62681b38c9e2a1379758a9562510a44928f11"],"system_stable_ref":"433a6877aa6a378bbd4b7e2752e484d8cb7499c562d68222be231f62ff2fa420","system_task_ref":"477333cc8c62c439f2c5af8d440c46066c7a774159da27ed7f968eece6af21b0","tools_ref":"52ab03d8ec104abb85572294bf8a469d75c5de9e74d6042caabff8017adc572b"},"response":{"text":"","thoughts":null,"tool_calls":[{"args":{"answer":"Estimativa ing\u00eanua (infer.ols): coef.radical_islamist = 0,7316.","caveats":[],"figure_refs":["call_df5fe7e4:coef.radical_islamist"]},"llm_name":"submit_answer","tool_id":null,"vendor_id":"script_2"}]},"response_id":null,"run_id":"20261015T171142Z-suite-causcibench_real-naive-d6494d","seq":3,"task_id":"causcibench_real.q124","timestamp":"2026-10-15T17:11:45.070780Z","usage":{"cached":0,"input":0,"output":0,"thoughts":0},"vendor":false}
{"attempt":1,"call_id":"call_5fe2645f","epoch":1,"event":"guard","numbers_found":["0,7316"],"retries_left":1,"run_id":"20261015T171142Z-suite-causcibench_real-naive-d6494d","seq":4,"task_id":"causcibench_real.q124","timestamp":"2026-10-15T17:11:45.072478Z","turn_id":"call_8bbab562","unbacked":[],"uncited":[],"verdict":"accepted"}
{"answer":"Estimativa ing\u00eanua (infer.ols): coef.radical_islamist = 0,7316.","answer_figure":{"call_id":"call_df5fe7e4","ci_high":1.0105700131293964,"ci_low":0.4527266901673069,"formatted":0.7316483516483516,"key":"coef.radical_islamist","ref":"call_df5fe7e4:coef.radical_islamist","se":0.1415607590885176,"tool_id":"infer.ols","unit":"","value":0.7316483516483516},"attempt":1,"caveats":[],"epoch":1,"event":"answer","figure_refs":["call_df5fe7e4:coef.radical_islamist"],"run_id":"20261015T171142Z-suite-causcibench_real-naive-d6494d","seq":5,"stopped":"answered","task_id":"causcibench_real.q124","timestamp":"2026-10-15T17:11:45.072638Z"}
{"attempt":1,"check":{"check_index":0,"detail":"every number backed","expected":null,"failure_class":null,"kind":"answer_backed","observed":[],"passed":true,"required":true,"source_id":null,"tolerance":null,"trace_call_id":null,"weight":1.0},"epoch":1,"event":"score","run_id":"20261015T171142Z-suite-causcibench_real-naive-d6494d","seq":6,"task_id":"causcibench_real.q124","timestamp":"2026-10-15T17:11:45.072638Z"}
{"attempt":1,"check":{"check_index":1,"detail":"0.7316483516 vs 0.417","expected":0.417,"failure_class":"out_of_tolerance","kind":"answer_figure_close","observed":0.7316483516483516,"passed":false,"required":true,"source_id":"causcibench_real.gold.q124","tolerance":{"abs_tol":null,"interval":null,"min_lre":null,"open_interval":false,"rel_tol":0.05,"rule":null},"trace_call_id":"call_df5fe7e4","weight":1.0},"epoch":1,"event":"score","run_id":"20261015T171142Z-suite-causcibench_real-naive-d6494d","seq":7,"task_id":"causcibench_real.q124","timestamp":"2026-10-15T17:11:45.072638Z"}