Datasets Overview Pt

Reusing dataset glue (/home/sgugger/.cache/huggingface/datasets/glue/mrpc/1.0.0/dacbe3125aa31d7f70367a07a8a9e72a5a0bfeb5fc42e75c9db75b96da6053ad)

DatasetDict({
,    train: Dataset({
,        features: ['sentence1', 'sentence2', 'label', 'idx'],
,        num_rows: 3668
,    })
,    validation: Dataset({
,        features: ['sentence1', 'sentence2', 'label', 'idx'],
,        num_rows: 408
,    })
,    test: Dataset({
,        features: ['sentence1', 'sentence2', 'label', 'idx'],
,        num_rows: 1725
,    })
,})

Dataset({
,    features: ['sentence1', 'sentence2', 'label', 'idx'],
,    num_rows: 3668
,})

{'idx': 6,
, 'label': 0,
, 'sentence1': 'The Nasdaq had a weekly gain of 17.27 , or 1.2 percent , closing at 1,520.15 on Friday .',
, 'sentence2': 'The tech-laced Nasdaq Composite .IXIC rallied 30.46 points , or 2.04 percent , to 1,520.15 .'}

{'idx': [0, 1, 2, 3, 4],
, 'label': [1, 0, 1, 0, 1],
, 'sentence1': ['Amrozi accused his brother , whom he called " the witness " , of deliberately distorting his evidence .',
,  "Yucaipa owned Dominick 's before selling the chain to Safeway in 1998 for $ 2.5 billion .",
,  'They had published an advertisement on the Internet on June 10 , offering the cargo for sale , he added .',
,  'Around 0335 GMT , Tab shares were up 19 cents , or 4.4 % , at A $ 4.56 , having earlier set a record high of A $ 4.57 .',
,  'The stock rose $ 2.11 , or about 11 percent , to close Friday at $ 21.51 on the New York Stock Exchange .'],
, 'sentence2': ['Referring to him as only " the witness " , Amrozi accused his brother of deliberately distorting his evidence .',
,  "Yucaipa bought Dominick 's in 1995 for $ 693 million and sold it to Safeway for $ 1.8 billion in 1998 .",
,  "On June 10 , the ship 's owners had published an advertisement on the Internet , offering the explosives for sale .",
,  'Tab shares jumped 20 cents , or 4.6 % , to set a record closing high at A $ 4.57 .',
,  'PG & E Corp. shares jumped $ 1.63 or 8 percent to $ 21.03 on the New York Stock Exchange on Friday .']}

{'sentence1': Value(dtype='string', id=None),
, 'sentence2': Value(dtype='string', id=None),
, 'label': ClassLabel(num_classes=2, names=['not_equivalent', 'equivalent'], names_file=None, id=None),
, 'idx': Value(dtype='int32', id=None)}

HBox(children=(FloatProgress(value=0.0, max=3668.0), HTML(value='')))

HBox(children=(FloatProgress(value=0.0, max=408.0), HTML(value='')))

HBox(children=(FloatProgress(value=0.0, max=1725.0), HTML(value='')))

{'train': ['attention_mask', 'idx', 'input_ids', 'label', 'sentence1', 'sentence2', 'token_type_ids'], 'validation': ['attention_mask', 'idx', 'input_ids', 'label', 'sentence1', 'sentence2', 'token_type_ids'], 'test': ['attention_mask', 'idx', 'input_ids', 'label', 'sentence1', 'sentence2', 'token_type_ids']}

Loading cached processed dataset at /home/sgugger/.cache/huggingface/datasets/glue/mrpc/1.0.0/dacbe3125aa31d7f70367a07a8a9e72a5a0bfeb5fc42e75c9db75b96da6053ad/cache-2b2682faffe74c3f.arrow

HBox(children=(FloatProgress(value=0.0, max=1.0), HTML(value='')))

Loading cached processed dataset at /home/sgugger/.cache/huggingface/datasets/glue/mrpc/1.0.0/dacbe3125aa31d7f70367a07a8a9e72a5a0bfeb5fc42e75c9db75b96da6053ad/cache-754363c6c40d803c.arrow

Dataset({
,    features: ['attention_mask', 'input_ids', 'labels', 'token_type_ids'],
,    num_rows: 3668
,})