Milvus Sparse Dense Embeddings Tutorial

Sparse Dense Embeddings Tutorial

image-searchvector-databasesemantic-searchmilvusembeddingsunstructured-dataquestion-answeringLLMmilvus-bootcampdeep-learningimage-recognitionimage-classificationaudio-searchPythonbootcampragNLP

alph-notebooks/milvus-bootcamp / sparse_dense_embeddings_tutorial.ipynb

Export

Run Notebooks

Contents

No cells yet

Add cells to see them here

[ ]

[1]

[2]

/Users/zilliz/.pyenv/lib/python3.9/site-packages/urllib3/__init__.py:34: NotOpenSSLWarning: urllib3 v2 only supports OpenSSL 1.1.1+, currently the 'ssl' module is compiled with 'LibreSSL 2.8.3'. See: https://github.com/urllib3/urllib3/issues/3020
  warnings.warn(

[5]

<3x27 sparse matrix of type '<class 'numpy.float64'>'
,	with 32 stored elements in Compressed Sparse Row format>

[7]

['1956' 'academic' 'ai' 'alan' 'an' 'artificial' 'as' 'born' 'conduct'
 'discipline' 'england' 'first' 'founded' 'in' 'intelligence' 'london'
 'maida' 'person' 'raised' 'research' 'southern' 'substantial' 'the' 'to'
 'turing' 'vale' 'was']
[[0.33907746 0.33907746 0.         0.         0.33907746 0.33907746
  0.33907746 0.         0.         0.33907746 0.         0.
  0.33907746 0.20026461 0.33907746 0.         0.         0.
  0.         0.         0.         0.         0.         0.
  0.         0.         0.20026461]
 [0.         0.         0.3119513  0.3119513  0.         0.
  0.         0.         0.3119513  0.         0.         0.3119513
  0.         0.18424347 0.         0.         0.         0.3119513
  0.         0.3119513  0.         0.3119513  0.3119513  0.3119513
  0.23724701 0.         0.18424347]
 [0.         0.         0.         0.         0.         0.
  0.         0.32751633 0.         0.         0.32751633 0.
  0.         0.38687284 0.         0.32751633 0.32751633 0.
  0.32751633 0.         0.32751633 0.         0.         0.
  0.24908461 0.32751633 0.19343642]]

[8]

[10]

'2.4.0'

[11]

/Users/zilliz/.pyenv/lib/python3.9/site-packages/transformers/utils/generic.py:441: UserWarning: torch.utils._pytree._register_pytree_node is deprecated. Please use torch.utils._pytree.register_pytree_node instead.
  _torch_pytree._register_pytree_node(
/Users/zilliz/.pyenv/lib/python3.9/site-packages/transformers/utils/generic.py:309: UserWarning: torch.utils._pytree._register_pytree_node is deprecated. Please use torch.utils._pytree.register_pytree_node instead.
  _torch_pytree._register_pytree_node(
/Users/zilliz/.pyenv/lib/python3.9/site-packages/transformers/utils/generic.py:309: UserWarning: torch.utils._pytree._register_pytree_node is deprecated. Please use torch.utils._pytree.register_pytree_node instead.
  _torch_pytree._register_pytree_node(

Fetching 23 files:   0%|          | 0/23 [00:00<?, ?it/s]

[13]

[14]

{'dense': [array([-0.02505933, -0.00142187,  0.04015452, ..., -0.0209493 ,
,          0.02623649,  0.00324106], dtype=float32),
,  array([ 0.00118473,  0.00649282, -0.0073576 , ..., -0.01446302,
,          0.04243686, -0.01794804], dtype=float32),
,  array([ 0.00415292, -0.01014923,  0.00098095, ..., -0.02559674,
,          0.08084681,  0.00141655], dtype=float32)],
, 'sparse': <3x250002 sparse array of type '<class 'numpy.float32'>'
, 	with 43 stored elements in Compressed Sparse Row format>}

[15]

[19]

[20]

Status(code=0, message=)

[21]

[23]

[24]

[25]

['["id: 448695871357611268, distance: 0.032786883413791656, entity: {\'text\': \'Alan Turing was the first person to conduct substantial research in AI.\'}", "id: 448695871357611267, distance: 0.016129031777381897, entity: {\'text\': \'Artificial intelligence was founded as an academic discipline in 1956.\'}"]']

[ ]