{"args":{},"checks":[{"abs_tol":null,"bind":"any","column":null,"failure_class":null,"field":"value","interval":false,"key":null,"kind":"answer_backed","min_lre":null,"note":"every number of the answer is stated by a tool call","open_interval":false,"rel_tol":null,"required":true,"source_id":null,"table":null,"tool":null,"value":null,"weight":1.0,"where":null},{"abs_tol":null,"bind":"answer_call","column":null,"failure_class":null,"field":"value","interval":true,"key":null,"kind":"answer_figure_close","min_lre":null,"note":"QRData eval.py: strictly inside gold \u00b1 3% (a '%' gold divided by 100), on the answer figure after meta.answer_format","open_interval":true,"rel_tol":null,"required":true,"source_id":"qrdata.gold.404","table":null,"tool":null,"value":[9.215,9.785],"weight":1.0,"where":null}],"datasets":{"florentine":{"columns":null,"description":"The CSV file, florentine.csv, contains an adjacency matrix whose entries represent the existence of relationships between two units (one unit represented by the row and the\nother represented by the column). Specifically, there are 16 elite Florentine families in the data, leading to a 16\u00d716 adjacency matrix. If the (i, j) entry of this adjacency matrix is 1, then it implies that the ith and jth Florentine families had a marriage relationship. In contrast, a value of 0 indicates the absence of a marriage.","file_sha256":"3c3a97cca6fdd96f6856f7856b5f8bc786a31d1a9be78c9f610ef3070783e970","format":"csv","frame_sha256":null,"generator":null,"kind":"file","licence":"CC BY-NC 4.0","member":"data/florentine.csv","object":null,"params":{},"path":null,"read_kw":{},"records":null,"role":"agent","sha256":"3c3a97cca6fdd96f6856f7856b5f8bc786a31d1a9be78c9f610ef3070783e970","transforms":[],"url":"https://raw.githubusercontent.com/xxxiaol/QRData/de450af45ff7101b328bb064c6b475f73414a7ed/benchmark/data.zip"}},"difficulty":"M","id":"qrdata_socsci.404","level":"T2","meta":{"agent_reach":{"blocked_by":["no_reference_path","no_tool:network_betweenness"],"dtypes":{},"named":{},"reachable":false,"rule":"magi_bench.reach/1"},"answer_format":{"figure_transform":"identity","round_to":3,"unit_scale":1.0},"answer_format_from":{"figure_transform":null,"round_to":"nearest thousandth","unit_scale":"1.0: an estimator's figure is on the gold's own scale"},"cluster":"florentine.csv","family":"numerical","headline_keys":{},"native":{"answer":"9.500","keywords":["Social science","Statistics","Network data","Centrality","Betweenness"],"multiple_choices":null,"question_type":"numerical","reference":"Quantitative Social Science 5.2.2"},"native_id":404,"reference":{"cite":1,"note":"Sem caminho de refer\u00eancia com as ferramentas registradas: no_tool:network_betweenness. A resposta n\u00e3o cita estimativa de efeito.","steps":[{"args":{"dataset":"florentine"},"tool":"data.describe","why":"Sem caminho de refer\u00eancia com as ferramentas registradas: no_tool:network_betweenness."}]},"reference_path":{"calls":[],"needs":["no_tool:network_betweenness"],"provenance":"none","quotes":{},"reference_datasets":[],"source_id":null},"reference_why":null},"question":"The betweenness of a node is a measure of centrality in a network. According to this measure, a node is considered to be central if it is responsible for connecting other nodes. In particular, if we assume that communication between a pair of nodes occurs through the shortest path between them, a node that lies on many such shortest paths may possess special leverage within a network. For a given node v, we calculate betweenness in three steps. First, compute the proportion of the shortest paths between two other nodes, t and u, that contain v. For example, two shortest paths occur between the Albizzi family and Tornabuon family, but we want only the proportion that contain v. Second, calculate this proportion for every unique pair of nodes t and u in the graph, excluding v. Third, sum all proportions.\nWhat is the betweenness of the BISCHERI family? Please round the result to the nearest thousandth.","requires":[],"runner":null,"sources":["qrdata.gold.404","qrdata.eval_py"],"split":"public","suite":"qrdata_socsci","tags":["econ-bench","external","qrdata","qss","numerical","no_reference_path"],"target":"agent","tool":null,"truth":"QRData gold: benchmark/QRData.json item 404 at de450af45ff7101b328bb064c6b475f73414a7ed"}