Skip to content

pageRank performance degradation 12 times! in 0.5 #232

@artem-aliev

Description

@artem-aliev

pageRank run 12 times slower with 0.5 compared to 0.4. What could be a reason?
Is other graph algorithms affected?

def time[A](f: => A) = {val s = System.nanoTime; val ret = f; println("time: "+(System.nanoTime-s)/1e6+"ms"); ret }

import org.graphframes._
val g = examples.Graphs.friends
val results2 = time { g.pageRank.resetProbability(0.15).maxIter(10).run() }

Spark 2.0.2 graphframes:graphframes:0.4.0-spark2.0-s_2.11, time: 6934ms
Spark 2.0.2 graphframes:graphframes:0.5.0-spark2.0-s_2.11, time: 87887ms

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions