Advertisement
Not a member of Pastebin yet?
Sign Up,
it unlocks many cool features!
- """
- Each element is a dictionary of attributes and their values for a post.
- Can you find the set of all attributes used throughout the RDD?
- The function dictionary.keys() gives you the list of attributes of a dictionary.
- :param dataset: dataset loaded in Spark context
- :type dataset: a Spark RDD
- :return: all unique attributes collected in a list
- """
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement